-- Logs begin at Mon 2022-07-04 05:06:40 UTC, end at Mon 2022-07-04 06:40:24 UTC. -- Jul 04 05:45:30.379086 dv-cinder-797333-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 05:45:30.388752 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 05:45:30 2022] *** Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: nodename: dv-cinder-797333-5-iscsi Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: machine: x86_64 Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: clock source: unix Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: pcre jit disabled Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: detected number of CPU cores: 4 Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: current working directory: / Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: detected binary path: /usr/bin/uwsgi-core Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: your processes number limit is 47680 Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: your memory page size is 4096 bytes Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: detected max file descriptor number: 2048 Jul 04 05:45:30.391034 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: lock engine: pthread robust mutexes Jul 04 05:45:30.392055 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: thunder lock: enabled Jul 04 05:45:30.392055 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 05:45:30.392055 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 05:45:30.441411 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: Python main interpreter initialized at 0x55953a2369c0 Jul 04 05:45:30.441411 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: python threads support enabled Jul 04 05:45:30.441411 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: your server socket listen backlog is limited to 100 connections Jul 04 05:45:30.441411 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: your mercy for graceful operations on workers is 90 seconds Jul 04 05:45:30.441763 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 05:45:30.441838 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: *** Operational MODE: preforking *** Jul 04 05:45:30.442068 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: *** uWSGI is running in multiple interpreter mode *** Jul 04 05:45:30.442068 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: spawned uWSGI master process (pid: 103125) Jul 04 05:45:30.442269 dv-cinder-797333-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 05:45:30.443361 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: spawned uWSGI worker 1 (pid: 103126, cores: 1) Jul 04 05:45:30.443361 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: spawned uWSGI worker 2 (pid: 103127, cores: 1) Jul 04 05:45:30.443361 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 05:45:31.093930 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 05:45:31.096350 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 05:45:32.207840 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:45:32.207840 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: from cryptography.utils import int_from_bytes Jul 04 05:45:32.208456 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:45:32.208456 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: from cryptography.utils import int_from_bytes Jul 04 05:45:32.208707 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:45:32.208707 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: from cryptography.utils import int_from_bytes Jul 04 05:45:32.209156 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:45:32.209156 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: from cryptography.utils import int_from_bytes Jul 04 05:45:34.630020 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 05:45:34.630722 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 05:45:34.631089 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 05:45:34.631185 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 05:45:34.631302 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 05:45:34.631392 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 05:45:34.631462 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 05:45:34.631528 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 05:45:34.631595 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 05:45:34.631665 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 05:45:34.631753 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.631834 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.632063 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.632172 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.632332 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.632435 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.632648 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.632749 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.632996 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.633129 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.633272 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.633374 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.633606 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.633741 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.633917 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.634051 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.634238 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.634387 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.634478 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.634564 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.634781 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.634915 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.635101 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797333-5-iscsi {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.635273 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797333-5-iscsi {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.635440 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.635573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.635735 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.635867 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.636049 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.636182 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.636347 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.636479 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.636631 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.636724 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.636942 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.637042 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.637241 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.637340 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.637730 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.637940 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.638203 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.638330 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.638504 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.638621 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.638808 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.638932 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.639132 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.639276 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.639466 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.639609 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.639746 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.639871 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.640066 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.640196 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.640357 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.640496 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.640687 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.640821 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.640973 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.641110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.641377 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797333-5-iscsi {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.641517 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797333-5-iscsi {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.641687 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.641821 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.641985 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.642114 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.642301 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.642430 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.642764 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.642916 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.643067 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.643181 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.643338 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.643474 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.643626 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.643767 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.643942 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.644073 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.644253 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.644397 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.644578 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.644715 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.644893 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.645026 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.645205 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.645345 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.645520 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.645651 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.645813 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.645936 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.646089 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.646227 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.646401 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.646530 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.646713 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.646842 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.647052 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.647187 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.647344 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.647469 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.647599 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.647724 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.647860 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.647984 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.648106 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.648228 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.648422 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.648552 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.648737 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.648873 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.648999 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.649132 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.649257 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.649395 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.649520 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.649649 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.649774 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.649897 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.650086 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.650223 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.650355 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.650485 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.650667 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.650798 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.650932 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.651056 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.651234 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.651415 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.651550 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.651674 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.651865 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.652004 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.652128 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.652259 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.652448 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.652585 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.652748 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.652966 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.653095 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.653230 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.653354 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.653490 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.653662 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.653791 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.654053 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.654193 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.654316 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.654447 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.654577 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.654699 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.654894 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.655026 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.655191 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.655375 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.655508 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.655635 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.655823 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.655953 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.656133 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.656275 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.656429 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.656558 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.656742 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.656872 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.657009 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.657140 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.657326 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.657463 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.657644 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.657785 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.657921 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.658045 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.658168 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.658290 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.658412 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.658541 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.658736 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.658866 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.659039 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.659167 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.659370 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.659514 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.659653 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.659777 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.659962 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.660092 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.660263 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.660402 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.660533 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.660656 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.660852 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.660981 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.661133 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.661269 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.661431 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.661576 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.661730 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.661870 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.662024 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.662165 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.662320 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.662452 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.662625 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.662762 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.662897 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.663109 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.663238 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.663426 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.663560 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.663691 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.663817 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.663948 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.664072 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.664194 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.664382 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.664522 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.664658 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.664790 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.664977 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.665113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.665268 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.665410 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.665565 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.665708 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.665888 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.666017 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.666189 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.666320 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.666472 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.666613 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.666787 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.666916 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.667087 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.667216 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.667405 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.667548 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.667723 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.667849 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.668000 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.668137 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.668316 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.668445 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.668621 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.668750 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.668922 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.669049 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.669267 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.669396 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.669558 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.669683 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.669862 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.669999 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.670132 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.670255 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.670440 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.670569 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.670721 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.670848 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.671026 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.671162 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.671326 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.671463 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.671638 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.671776 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.671956 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.672085 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.672238 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.672367 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.672543 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.672750 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.672875 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.672996 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.673131 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.673321 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:45:34.673448 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.673580 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.673752 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.673883 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.674084 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.674214 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.674398 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.674535 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.674728 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.674859 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.675055 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.675185 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.675401 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.675531 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.675707 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.675837 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.676018 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.676145 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.676331 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.676471 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.676625 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.676754 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.676941 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.677071 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.677209 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.677336 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.677534 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.677663 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.677844 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.678002 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.678145 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.678270 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.678459 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.678589 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.678770 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.678899 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.679080 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.679208 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.679381 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.679506 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.679701 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.679845 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.680023 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.680153 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.680336 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.680465 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.680637 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.680779 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.680970 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.681099 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.681301 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.681433 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.681605 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.681750 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.681925 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.682065 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.682238 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.682369 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.682529 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.682668 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.682830 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.682959 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.683146 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.683307 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.683511 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.683647 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.683780 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.683910 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.684093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.684222 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.684394 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.684526 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.684707 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.684846 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.685039 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.685169 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.685331 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.685462 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.685646 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.685776 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.685949 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.686088 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.686270 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.686400 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.686580 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.686720 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.686892 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.687021 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.687183 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.687369 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.687860 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.687994 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.688172 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.688315 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.688444 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.688578 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.688770 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.688908 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.689031 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.689162 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.689346 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.689475 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.689636 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.689769 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.689946 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.690086 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.690211 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.690341 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.690528 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.690657 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.690854 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.690990 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.691159 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.691300 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.691514 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.691653 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.691819 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.691953 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.692131 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.692266 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.692434 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.692562 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.692736 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.692865 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.693035 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.693162 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.693338 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.693486 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.693688 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.693824 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.693949 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.694081 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.694205 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.694336 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.694506 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.694633 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.694802 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.694929 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.695118 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.695390 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.695519 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.695642 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.695764 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.695896 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.696029 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.696160 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.696311 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.696438 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.696613 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.696738 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.696912 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.697047 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.697216 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.697343 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.697529 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.697655 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.697830 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.697965 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.698133 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.698260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.698460 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.698585 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.698784 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.698918 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.699081 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.699215 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.699421 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.699548 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.699738 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.699865 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.700049 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.700181 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.700342 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.700513 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.700720 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.700937 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.701112 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.701246 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.701359 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.701534 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.701671 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.701828 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.701963 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.702124 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.702263 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.702401 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.702525 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.702698 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.702824 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.702992 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.703118 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.703290 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.703418 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.703608 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.703827 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.703957 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.704078 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.704212 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.704344 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.704468 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.704590 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.704746 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.704880 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.705067 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.705201 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.705362 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.705486 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.705693 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.705834 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.706068 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.706195 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.706344 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.706471 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.706660 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.706801 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.706980 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.707107 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.707308 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.707438 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.707612 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.707750 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.707917 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.708042 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.708221 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.708347 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.708528 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.708664 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.708831 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.708957 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.709133 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.709258 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.709439 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.709575 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.709737 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.709872 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.710049 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.710181 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.710347 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.710472 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.710656 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.710790 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.710950 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.711077 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.711288 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.711415 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.711594 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.711735 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.711913 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.712037 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.712220 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.712346 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.712529 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.712655 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.712831 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.712960 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.713135 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.713262 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.713434 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.713568 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.713734 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.713948 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.714075 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.714206 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.714328 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.714450 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.714612 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.714747 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.714911 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.715046 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.715213 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.715359 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.715547 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.715686 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.715867 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.715993 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.716172 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.716296 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.716482 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.716622 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.716777 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.716905 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.717081 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.717207 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.717402 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.717528 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.717725 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.717851 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.718027 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.718154 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.718328 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.718465 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.718643 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.718769 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.718951 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.719090 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.719298 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.719429 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.719563 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.719687 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.719866 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.720003 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.720165 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.720291 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.720465 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.720590 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.720782 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.720915 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.721071 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.721198 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.721373 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.721498 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.721685 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.721822 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.721987 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.722123 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.722298 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.722424 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.722602 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.722740 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.722904 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.723038 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.723203 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.723348 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.723534 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.723741 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.723867 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.724070 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.724197 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.724321 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.724443 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.724580 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.724705 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.724828 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.724990 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.725116 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.725304 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.725432 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.725697 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.725907 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.726034 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.726157 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.726290 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.726418 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.726541 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.726664 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.726787 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.726910 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.727048 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.727172 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.727343 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.727471 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.727660 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.727794 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.727973 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.728101 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.728274 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.728407 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.728581 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.728717 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.728888 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.729014 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.729190 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.729316 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.729494 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.729628 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.729796 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.729921 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.730096 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.730222 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.730397 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.730531 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.730695 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.730820 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.730995 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.731129 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.731317 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.731458 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.731624 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.731784 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.731974 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.732159 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.732294 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.732419 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.732542 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.732674 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.732839 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.732967 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.733137 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.733264 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.733444 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.733571 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.733756 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.734007 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.734322 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.734462 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.734626 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.734753 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.734936 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.735063 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.735281 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.735412 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.735574 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.735714 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.735903 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.736048 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.736201 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.736326 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.736522 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.736648 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.736824 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.736961 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.737154 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.737293 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.737462 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.737591 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.737765 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.737894 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.738068 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.738195 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.738370 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.738505 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.738667 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.738802 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.738964 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.739101 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.739277 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.739405 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.739575 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.739700 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.739870 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.740011 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.740164 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.740299 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.740458 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.740586 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.740755 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.740890 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.741046 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.741172 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.741348 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.741475 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.741640 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.741774 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.741940 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.742066 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.742238 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.742376 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.742531 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.742658 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.742823 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.742958 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.743118 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.743265 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.743455 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.743582 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.743755 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.743880 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.744082 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.744207 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.744399 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.744525 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.744726 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.744851 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.745019 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.745153 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.745318 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.745444 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.745629 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.745755 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.745973 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.746114 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.746249 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.746381 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.746514 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.746638 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.746761 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.746970 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.747096 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.747225 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.747426 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.747549 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.747671 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.747812 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.747937 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.748066 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.748239 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.748367 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.748542 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.748679 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.748841 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.748967 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.749140 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.749267 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.749432 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.749568 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.749726 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.749852 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.750021 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.750145 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.750314 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.750441 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.750610 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.750735 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.750909 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.751033 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.751207 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.751397 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.751524 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.751646 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.751812 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.751939 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.752103 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.752239 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.752399 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.752525 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.752710 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.752859 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.753010 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.753133 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.753300 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.753428 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.753600 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.753740 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.753907 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.754039 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.754212 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.754346 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.754511 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.754649 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.754812 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.754937 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.755108 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.755278 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.755430 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.755582 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.755719 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.755842 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.756053 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.756192 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.756328 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.756452 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.756582 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.756715 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.756877 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.757002 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.757181 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.757306 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.757476 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.757609 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.757775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.757902 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.758067 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.758193 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.758363 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.758497 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.758658 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.758785 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.758957 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.759084 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.759266 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.759393 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.759564 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.759703 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.759859 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.759986 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.760151 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.760278 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.760444 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.760580 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.760739 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.760864 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.761042 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.761166 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.761336 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.761471 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.761633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.761761 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.761928 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.762054 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.762221 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.762355 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.762540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.762674 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.762844 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.763014 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.763226 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.763406 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.763555 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.763680 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.763866 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.763992 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.764171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.764305 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.764473 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.764602 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.764777 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.764901 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.765070 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.765196 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.765375 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.765499 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.765674 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.765797 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.765977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.766163 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.766361 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.766495 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.766627 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.766760 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.766884 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.767014 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.767138 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.767318 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.767444 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.767587 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.767747 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.767874 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.768059 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.768194 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.768379 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.768513 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.768699 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.768826 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.768999 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.769125 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.769307 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.769444 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.769613 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.769772 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.769920 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.770047 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.770221 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.770354 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.770522 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.770649 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.770842 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.770970 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.771102 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.771233 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.771432 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.771572 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.771735 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.771861 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.772037 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.772164 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.772336 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.772463 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.772633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.772758 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.772930 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.773070 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.773231 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.773348 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.773531 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.773667 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.773826 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.773952 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.774127 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.774251 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.774422 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.774629 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.774755 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.774876 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.774998 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.775126 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.775304 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.775442 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.775710 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.775836 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.776013 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.776138 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.776309 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.776521 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.776658 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.776787 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.776910 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.777031 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.777192 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.777319 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.777495 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.777628 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.777792 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.777918 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.778092 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.778217 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.778493 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.778646 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.778828 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.778963 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.779133 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.779290 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.779455 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.779581 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.779753 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.779893 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.780050 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.780175 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.780358 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.780485 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.780655 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.780780 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.780953 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.781080 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.781247 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.781382 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.781544 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.781680 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.781842 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.781968 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.782147 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.782279 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.782462 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.782598 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.782840 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.782966 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.783140 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.783314 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.783490 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.783633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.783898 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.784034 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.784206 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.784333 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.784514 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.784641 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.784832 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.784968 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.785149 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.785276 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.785467 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.785594 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.785767 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.785904 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.786079 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.786208 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.786387 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.786535 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.786737 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.786864 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.786996 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.787124 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.787300 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.787429 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.787602 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.787730 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.787915 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.788040 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.788227 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.788352 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.788535 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.788663 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.788843 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.788968 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.789164 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.789301 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.789548 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.789673 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.789851 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.789979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.790162 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.790307 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.790477 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.790604 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.790774 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.790894 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.791072 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.791210 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.791399 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.791524 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.791686 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.791813 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.791983 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.792119 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.792283 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.792410 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.792580 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.792706 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.792883 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.793011 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.793185 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.793311 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.793490 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.793615 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.793785 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.793910 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.794081 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.794250 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.794431 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.794557 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.794730 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.794856 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.795039 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.795164 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.795367 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.795506 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.795684 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.795811 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.795998 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.796125 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.796294 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.796434 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.796599 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.796748 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.796938 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.797070 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.797195 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.797333 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.797458 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.797581 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.797743 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.797871 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.798062 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.798197 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.798359 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.798484 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.798676 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.798803 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.798989 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.799123 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.799332 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.799473 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.799658 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.799786 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.799965 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.800100 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.800296 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.800424 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.800623 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.800750 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.800938 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.801066 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.801253 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.801380 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.801546 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.801671 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.801847 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.801974 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.802148 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.802274 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.802446 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.802571 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.802742 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.802871 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.803037 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.803162 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.803357 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.803494 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.803653 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.803777 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.803948 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.804084 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.804241 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.804375 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.804538 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.804671 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.804835 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.804962 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.805138 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.805273 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.805436 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.805561 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.805731 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.805872 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.806069 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.806206 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.806338 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.806462 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.806587 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.806708 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.806918 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.807117 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.807292 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.807436 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.807561 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.807683 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.807845 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.807971 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.808161 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.808286 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.808464 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.808602 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.808775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.808901 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.809083 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.809217 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.809394 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.809521 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.809698 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.809869 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.810055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.810183 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.810364 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.810498 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.810671 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.810799 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.810977 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.811095 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.811306 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.811448 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.811618 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.811749 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.811926 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.812060 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.812231 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.812367 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.812890 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.813081 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.813403 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.813530 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.813711 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.813887 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.814027 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.814152 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.814310 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.814439 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.814614 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.814741 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.814918 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.815044 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.815224 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.815402 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.815560 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.815734 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.815869 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.816043 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.816169 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.816347 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.816484 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.816668 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.816795 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.816982 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.817123 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.817326 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.817454 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.817663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.817791 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.817979 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.818105 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.818287 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.818415 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.818593 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.818721 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.818906 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.819032 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.819268 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.819415 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.819588 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.819717 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.819892 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.820028 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.820199 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.820334 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.820508 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.820644 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.820817 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.821105 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.821226 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.821348 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.821480 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.821603 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.821740 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.821864 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.821987 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.822109 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.822281 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.822408 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.822585 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.822715 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.822892 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.823018 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.823200 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.823395 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.823540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.823663 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.823853 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.823981 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.824169 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.824309 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.824479 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.824606 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.824785 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.824912 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.825093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.825228 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.825623 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.825754 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.825976 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.826110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.826254 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.826391 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.826572 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.826700 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.826892 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.827029 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.827199 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.827413 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.827542 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.827665 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.827836 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.827963 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.828166 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.828292 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.828423 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.828555 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.828718 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.828853 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.829024 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.829151 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.829318 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.829444 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.829633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.829760 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.829936 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.830063 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.830236 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.830361 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.830551 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.830686 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.830858 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.830983 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.831397 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.831538 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.831741 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.831881 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.832055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.832182 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.832376 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.832501 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.832692 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.832826 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.833000 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.833126 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.833298 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.833434 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.833611 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.833747 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.833909 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.834037 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.834206 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.834334 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.834513 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.834649 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.834817 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.834952 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.835112 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.835262 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.835433 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.835563 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.835738 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.835873 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.836040 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.836176 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.836338 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.836468 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.836642 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.836768 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.836936 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.837061 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.837254 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.837397 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.837586 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.837711 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.837836 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.837967 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.838112 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.838240 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.838414 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.838549 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.838712 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.838846 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.839007 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.839135 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.839328 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.839457 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.839624 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.839765 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.839927 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.840054 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.840223 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.840357 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.840518 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.840655 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.840815 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.840948 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.841163 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.841291 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.841462 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.841589 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.841762 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.842099 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.842232 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.842413 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.842550 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.842706 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.842842 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.843001 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.843135 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.843333 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.843462 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.843641 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.843769 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.844021 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.844154 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.844293 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.844417 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.844540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.844664 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.844873 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.845009 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.845184 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.845310 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.845709 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.845837 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.846036 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.846179 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.846355 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.846480 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.846688 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.846817 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.847016 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.847153 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.847420 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.847575 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.847764 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.847891 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.848014 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.848148 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.848326 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.848461 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.848636 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.848763 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.848939 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.849074 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.849241 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.849368 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.849547 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.849673 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.849847 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.849973 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.850153 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.850279 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.850459 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.850585 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.850761 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.850896 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.851062 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.851189 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.851386 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.851522 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.851691 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.851818 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.851994 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.852119 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.852294 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.852431 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.852599 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.852726 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.852931 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.853057 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.853243 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.853377 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.853550 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.853675 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.853861 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.853987 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.854199 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.854334 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.854457 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.854584 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.854755 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.854881 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.855056 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.855183 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.855379 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.855510 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.855686 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.855813 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.856008 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.856137 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.856314 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.856448 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.856610 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.856836 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.857035 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.857163 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.857341 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.857469 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.857653 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.857807 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.857996 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.858126 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.858249 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.858372 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.858556 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.858698 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.858869 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.858994 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.859168 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.859332 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.859506 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.859634 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.859809 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.859935 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.860129 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.860255 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.860460 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.860589 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.860778 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.860913 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.861093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.861221 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.861389 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.861516 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.861684 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.861820 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.861978 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.862104 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.862282 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.862415 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.862591 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.862716 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.862892 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.863027 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.863190 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.863335 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.863510 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.863636 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.863812 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.863956 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.864107 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.864261 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.864386 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.864517 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.864683 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.864820 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.864978 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.865112 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.865276 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.865403 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.865568 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.865712 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.865863 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.865987 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.866153 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.866278 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.866446 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.866581 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.866741 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.866868 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.867034 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.867169 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.867355 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.867482 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.867648 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.867775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.867943 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.868144 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.868285 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.868409 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.868539 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.868662 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.868785 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.868915 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.869108 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.869244 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.869431 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.869557 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.869738 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.869872 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.870050 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.870174 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.870351 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.870477 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.870663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.870800 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.870966 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.871090 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.871298 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.871440 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.871614 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.871743 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.871922 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.872046 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.872221 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.872389 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.872595 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.872735 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.872909 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.873043 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.873209 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.873335 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.873512 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.873639 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.873813 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.873947 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.874114 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.874249 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.874417 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.874544 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.874733 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.874868 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.875048 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.875174 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.875368 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.875497 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.875688 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.875822 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.875995 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.876131 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.876305 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.876432 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.876613 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.876738 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.876912 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.877051 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.877230 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.877358 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.877534 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.877659 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.877825 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.877983 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.878205 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.878341 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.878473 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.878599 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.878731 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.878855 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.879032 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.879159 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.879420 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.879550 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.879743 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.879871 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.880061 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.880186 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.880364 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.880490 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.880681 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.880806 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.880993 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.881125 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.881330 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.881458 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.881633 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.881759 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.881965 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.882091 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.882284 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.882421 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.882592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.882728 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.882894 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.883022 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.883190 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.883351 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:45:34.883477 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 05:45:34.883609 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 05:45:34.944541 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO dbcounter [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Registered counter for database nova_api Jul 04 05:45:34.944745 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO dbcounter [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] Registered counter for database nova_api Jul 04 05:45:35.061782 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_db.sqlalchemy.engines [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:45:35.065315 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG oslo_db.sqlalchemy.engines [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:45:35.068495 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writer thread running {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:45:35.072860 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG dbcounter [-] [103127] Writer thread running {{(pid=103127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:45:35.123652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.context [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b04425d4-b271-4f52-96b4-9703962c8b23(cell1) {{(pid=103126) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 05:45:35.127599 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:45:35.127838 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.context [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b04425d4-b271-4f52-96b4-9703962c8b23(cell1) {{(pid=103127) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 05:45:35.129154 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:45:35.129952 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:45:35.131758 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG oslo_concurrency.lockutils [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:45:35.132065 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:45:35.133302 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG oslo_concurrency.lockutils [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:45:35.134057 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO dbcounter [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Registered counter for database nova_cell0 Jul 04 05:45:35.134190 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG oslo_concurrency.lockutils [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:45:35.136239 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG oslo_concurrency.lockutils [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:45:35.137892 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO dbcounter [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Registered counter for database nova_cell1 Jul 04 05:45:35.138334 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO dbcounter [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] Registered counter for database nova_cell0 Jul 04 05:45:35.142299 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO dbcounter [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] Registered counter for database nova_cell1 Jul 04 05:45:35.146270 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_db.sqlalchemy.engines [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:45:35.147552 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_db.sqlalchemy.engines [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:45:35.151928 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG oslo_db.sqlalchemy.engines [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:45:35.152675 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG oslo_db.sqlalchemy.engines [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:45:35.154069 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writer thread running {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:45:35.155681 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writer thread running {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:45:35.159812 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG dbcounter [-] [103127] Writer thread running {{(pid=103127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:45:35.161918 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG dbcounter [-] [103127] Writer thread running {{(pid=103127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:45:35.297303 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO dbcounter [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Registered counter for database nova_cell0 Jul 04 05:45:35.304220 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO dbcounter [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] Registered counter for database nova_cell0 Jul 04 05:45:35.306525 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_db.sqlalchemy.engines [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:45:35.312035 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writer thread running {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:45:35.313764 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG oslo_db.sqlalchemy.engines [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:45:35.318726 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG dbcounter [-] [103127] Writer thread running {{(pid=103127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:45:35.647079 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: WARNING keystonemiddleware.auth_token [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 05:45:35.651596 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: WARNING keystonemiddleware.auth_token [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 05:45:35.654376 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: WARNING keystonemiddleware.auth_token [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 05:45:35.659181 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: WARNING keystonemiddleware.auth_token [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 05:45:35.993686 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: WARNING keystonemiddleware.auth_token [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 05:45:35.999008 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: WARNING keystonemiddleware.auth_token [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 05:45:35.999738 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: WARNING keystonemiddleware.auth_token [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 05:45:36.004960 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55953a2369c0 pid: 103126 (default app) Jul 04 05:45:36.005253 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: WARNING keystonemiddleware.auth_token [None req-da88962a-41fe-4cfa-a33d-07310f8cc210 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 05:45:36.007017 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:45:36.008257 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001780 Jul 04 05:45:36.008668 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Mon Jul 4 05:45:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:45:36.010288 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55953a2369c0 pid: 103127 (default app) Jul 04 05:46:51.235396 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:46:51.237122 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002251 Jul 04 05:46:51.242970 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:46:51 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:46:51.250492 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG dbcounter [-] [103127] Writing DB stats nova_api:SELECT=3 {{(pid=103127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:51.251652 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG dbcounter [-] [103127] Writing DB stats nova_cell0:SELECT=3 {{(pid=103127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:51.252655 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG dbcounter [-] [103127] Writing DB stats nova_cell1:SELECT=3 {{(pid=103127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:51.253427 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG dbcounter [-] [103127] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:51.670856 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-482f1940-7351-4131-be1a-01c03aba1872 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:46:51.701514 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-482f1940-7351-4131-be1a-01c03aba1872 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.456425 Jul 04 05:46:51.702309 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jul 4 05:46:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:46:53.762561 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:46:53.764168 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-234d7761-c496-4b4a-934e-e321152e6258 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002002 Jul 04 05:46:53.764823 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:46:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:46:53.825411 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-02b5ae20-7c4e-405c-847d-b8458aa1f2f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "disk": 1, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:46:53.843524 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:46:53.843524 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: warnings.warn(msg) Jul 04 05:46:53.873135 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-02b5ae20-7c4e-405c-847d-b8458aa1f2f0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102560 Jul 04 05:46:53.875629 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 4 05:46:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:46:54.088022 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-9ea2bdf8-3983-4a4c-b693-4d8a89e47b48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:46:54.090465 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:46:54.090465 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: warnings.warn(msg) Jul 04 05:46:54.093207 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writing DB stats nova_api:SELECT=3 {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:54.094004 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writing DB stats nova_cell0:SELECT=3 {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:54.095207 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writing DB stats nova_cell1:SELECT=3 {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:54.095913 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:54.161326 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-9ea2bdf8-3983-4a4c-b693-4d8a89e47b48 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278251 Jul 04 05:46:54.162239 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jul 4 05:46:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:46:56.281276 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-02b5ae20-7c4e-405c-847d-b8458aa1f2f0 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:46:56.282299 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-02b5ae20-7c4e-405c-847d-b8458aa1f2f0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 04 05:46:56.282704 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:46:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:46:56.390055 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-1a6ceda9-9ef3-4a72-9500-7a0253314bed admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "vcpus": 1, "disk": 5, "id": "d1"}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:46:56.408266 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:46:56.408266 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: warnings.warn(msg) Jul 04 05:46:56.428488 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-1a6ceda9-9ef3-4a72-9500-7a0253314bed admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139734 Jul 04 05:46:56.429052 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 4 05:46:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:46:56.441703 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-88445a4a-085d-44ac-9d71-8616fe08fc6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:46:56.443304 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:46:56.443304 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: warnings.warn(msg) Jul 04 05:46:56.478208 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-88445a4a-085d-44ac-9d71-8616fe08fc6a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040468 Jul 04 05:46:56.478803 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jul 4 05:46:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:46:58.548233 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-1a6ceda9-9ef3-4a72-9500-7a0253314bed admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:46:58.549245 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-1a6ceda9-9ef3-4a72-9500-7a0253314bed admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 04 05:46:58.549666 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:46:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:46:58.609396 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-4f53146f-d789-4d34-aba5-f41579aa11c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "disk": 10, "ram": 1024}} {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:46:58.629195 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-4f53146f-d789-4d34-aba5-f41579aa11c1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073430 Jul 04 05:46:58.629746 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 4 05:46:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:46:58.641964 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-ac46751e-7088-48f2-be9f-5cd8b9dc37c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:46:58.665327 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-ac46751e-7088-48f2-be9f-5cd8b9dc37c5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027339 Jul 04 05:46:58.666213 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jul 4 05:46:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:47:00.727175 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-4f53146f-d789-4d34-aba5-f41579aa11c1 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:00.728246 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-4f53146f-d789-4d34-aba5-f41579aa11c1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 04 05:47:00.728652 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:00.788048 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-28b8b94c-64d9-4d30-bf28-d74272f24ef7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:00.808403 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-28b8b94c-64d9-4d30-bf28-d74272f24ef7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073922 Jul 04 05:47:00.809313 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 4 05:47:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:47:00.821345 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-554fe98e-9231-4092-af6a-ed2fca8bf480 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:00.845637 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-554fe98e-9231-4092-af6a-ed2fca8bf480 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027893 Jul 04 05:47:00.846519 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jul 4 05:47:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:47:02.901572 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-28b8b94c-64d9-4d30-bf28-d74272f24ef7 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:02.902579 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-28b8b94c-64d9-4d30-bf28-d74272f24ef7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 04 05:47:02.902957 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:47:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:02.972510 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-73072759-129b-4823-bbd4-360788e94610 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:02.994022 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-73072759-129b-4823-bbd4-360788e94610 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085136 Jul 04 05:47:02.994581 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 4 05:47:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 05:47:03.008407 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-9a462910-45d5-475e-8943-5c8385e59c58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:03.033792 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-9a462910-45d5-475e-8943-5c8385e59c58 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029118 Jul 04 05:47:03.034342 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jul 4 05:47:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:47:05.114600 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-73072759-129b-4823-bbd4-360788e94610 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:05.115615 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-73072759-129b-4823-bbd4-360788e94610 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 04 05:47:05.116233 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:05.179000 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-0e192542-e797-4b52-b3cc-13abf0190f4b admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:05.204073 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-0e192542-e797-4b52-b3cc-13abf0190f4b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081602 Jul 04 05:47:05.204833 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jul 4 05:47:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:47:07.293489 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-73072759-129b-4823-bbd4-360788e94610 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:07.294496 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-73072759-129b-4823-bbd4-360788e94610 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 04 05:47:07.294933 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:07.364512 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-5ba41545-c1f4-4687-8cd3-df7418ef47a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:07.387577 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-5ba41545-c1f4-4687-8cd3-df7418ef47a9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084927 Jul 04 05:47:07.387577 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 4 05:47:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:47:07.401000 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-f93c43e5-28a9-4652-967f-aeee5c27652c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:07.425340 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-f93c43e5-28a9-4652-967f-aeee5c27652c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028156 Jul 04 05:47:07.425939 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jul 4 05:47:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:47:09.723643 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-5ba41545-c1f4-4687-8cd3-df7418ef47a9 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:09.724726 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-5ba41545-c1f4-4687-8cd3-df7418ef47a9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Jul 04 05:47:09.725143 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:09.789415 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-608daecf-d675-404c-8730-a80e3dc19836 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20}} {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:09.809763 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-608daecf-d675-404c-8730-a80e3dc19836 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078446 Jul 04 05:47:09.810347 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 4 05:47:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 05:47:09.823273 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-0c9b92a4-31f1-4385-a568-4495dbcaabd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:09.856087 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-0c9b92a4-31f1-4385-a568-4495dbcaabd0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036961 Jul 04 05:47:09.856823 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jul 4 05:47:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:47:12.482579 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-608daecf-d675-404c-8730-a80e3dc19836 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:12.483647 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-608daecf-d675-404c-8730-a80e3dc19836 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jul 04 05:47:12.484138 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:47:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:12.545106 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-d476b1b0-b128-4980-91d1-d827e408f058 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "disk": 40}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:12.564476 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-d476b1b0-b128-4980-91d1-d827e408f058 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074044 Jul 04 05:47:12.565033 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 4 05:47:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:47:12.580651 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-d4dcf4b1-aefb-41e0-9ab2-f6cf479e5ee5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:12.604916 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-d4dcf4b1-aefb-41e0-9ab2-f6cf479e5ee5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028374 Jul 04 05:47:12.605545 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jul 4 05:47:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:47:14.710040 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-d476b1b0-b128-4980-91d1-d827e408f058 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:14.711044 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-d476b1b0-b128-4980-91d1-d827e408f058 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 04 05:47:14.711474 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:47:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:14.771541 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-3ec0d0a3-2611-4f4d-92a8-2d5b9930769d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "id": "4", "swap": 0, "rxtx_factor": 1.0, "disk": 80, "ram": 8192}} {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:14.790781 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-3ec0d0a3-2611-4f4d-92a8-2d5b9930769d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073395 Jul 04 05:47:14.791387 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 4 05:47:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:47:14.803344 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-638a2713-01b9-436f-ab95-5c9340cb3468 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:14.827818 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-638a2713-01b9-436f-ab95-5c9340cb3468 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028219 Jul 04 05:47:14.828389 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jul 4 05:47:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:47:16.923632 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-3ec0d0a3-2611-4f4d-92a8-2d5b9930769d admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:16.926262 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-3ec0d0a3-2611-4f4d-92a8-2d5b9930769d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003398 Jul 04 05:47:16.926957 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:47:16 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:16.994903 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-e1bf4ab4-653f-4801-8b81-9f8e60971cc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:17.014218 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-e1bf4ab4-653f-4801-8b81-9f8e60971cc4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080873 Jul 04 05:47:17.014777 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 4 05:47:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:47:17.029190 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-9cf9098c-2c06-40e7-a1ab-b64e5cda5ab1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:17.054309 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-9cf9098c-2c06-40e7-a1ab-b64e5cda5ab1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031417 Jul 04 05:47:17.054910 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jul 4 05:47:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:47:40.986359 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-e1bf4ab4-653f-4801-8b81-9f8e60971cc4 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:40.987390 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-e1bf4ab4-653f-4801-8b81-9f8e60971cc4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 04 05:47:40.987795 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:41.001810 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG dbcounter [-] [103127] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:47:41.053449 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-fd0b9d04-5ffa-4cd5-9221-79018c651303 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:41.073209 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-fd0b9d04-5ffa-4cd5-9221-79018c651303 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.078966 Jul 04 05:47:41.073753 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jul 4 05:47:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:47:42.003072 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-e1bf4ab4-653f-4801-8b81-9f8e60971cc4 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:42.004108 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-e1bf4ab4-653f-4801-8b81-9f8e60971cc4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 04 05:47:42.004489 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:47:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:42.202597 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-4337901f-7f82-4bff-9464-299d7dab8f8c admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:42.208359 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.wsgi [None req-4337901f-7f82-4bff-9464-299d7dab8f8c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-4337901f-7f82-4bff-9464-299d7dab8f8c admin admin] Request method failure captured: Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Accept: application/json Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Accept-Encoding: gzip, deflate Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Connection: keep-alive Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Content-Length: 0 Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Host: 10.222.0.42 Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Openstack-Api-Version: compute 2.90 Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Openstack-System-Scope: None Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: User-Agent: python-novaclient Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Auth-Token: gAAAAABiwn79bcy6303h6EqqnQc7pJenhRmLq7EX-K8AnLzCG2vxH7Ii0ve9jP_yMoq7sXG_5MgKM0pyph4J04IuOEibMovfy58ZUxxoHonlQP9kpaaUErN-12cjiCrNg855BXwbPX-ryUB9spe6n1jEvHNxEW-22VtCvTAzyuvnhFEf3XwgSEY Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Domain-Id: None Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Domain-Name: None Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Identity-Status: Confirmed Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Is-Admin-Project: True Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Domain-Id: default Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Domain-Name: Default Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Name: admin Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Role: reader,member,admin Jul 04 05:47:42.211633 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Roles: reader,member,admin Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Tenant: admin Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Tenant-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Tenant-Name: admin Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User: admin Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Domain-Id: default Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Domain-Name: Default Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Id: 825e62d400e54cc0868912432c257354 Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Name: admin Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: method: > Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: exception: Flavor 42 could not be found. Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: action_args: {'id': '42'} Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:47:42.213236 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:42.214055 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:42.215157 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-4337901f-7f82-4bff-9464-299d7dab8f8c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:47:42.216275 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-4337901f-7f82-4bff-9464-299d7dab8f8c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.071631 Jul 04 05:47:42.216275 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jul 4 05:47:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 05:47:42.222810 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-93531d55-a308-42ea-be2c-63f407bfd71f admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:42.225743 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:47:42.245364 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-93531d55-a308-42ea-be2c-63f407bfd71f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026110 Jul 04 05:47:42.246061 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 4 05:47:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:47:42.256156 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-3ccb69bf-9537-46eb-9d78-2b388f3035fc admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:42.277634 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-3ccb69bf-9537-46eb-9d78-2b388f3035fc admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025117 Jul 04 05:47:42.278146 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 4 05:47:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:47:42.288712 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-c38bdfbc-6d1e-412d-887c-a271eb316959 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:42.295058 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.wsgi [None req-c38bdfbc-6d1e-412d-887c-a271eb316959 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-c38bdfbc-6d1e-412d-887c-a271eb316959 admin admin] Request method failure captured: Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Accept: application/json Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Accept-Encoding: gzip, deflate Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Connection: keep-alive Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Content-Length: 0 Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Host: 10.222.0.42 Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Openstack-Api-Version: compute 2.90 Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Openstack-System-Scope: None Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: User-Agent: python-novaclient Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Auth-Token: gAAAAABiwn79bcy6303h6EqqnQc7pJenhRmLq7EX-K8AnLzCG2vxH7Ii0ve9jP_yMoq7sXG_5MgKM0pyph4J04IuOEibMovfy58ZUxxoHonlQP9kpaaUErN-12cjiCrNg855BXwbPX-ryUB9spe6n1jEvHNxEW-22VtCvTAzyuvnhFEf3XwgSEY Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Domain-Id: None Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Domain-Name: None Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Identity-Status: Confirmed Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Is-Admin-Project: True Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Domain-Id: default Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Domain-Name: Default Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Name: admin Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Role: reader,member,admin Jul 04 05:47:42.298682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Roles: reader,member,admin Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Tenant: admin Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Tenant-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Tenant-Name: admin Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User: admin Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Domain-Id: default Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Domain-Name: Default Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Id: 825e62d400e54cc0868912432c257354 Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Name: admin Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: method: > Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: exception: Flavor 42 could not be found. Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: action_args: {'id': '42'} Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:47:42.300110 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:42.300888 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:42.302113 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-c38bdfbc-6d1e-412d-887c-a271eb316959 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:47:42.303319 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-c38bdfbc-6d1e-412d-887c-a271eb316959 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015776 Jul 04 05:47:42.303319 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jul 4 05:47:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 05:47:43.121992 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-3ccb69bf-9537-46eb-9d78-2b388f3035fc admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:43.123007 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-3ccb69bf-9537-46eb-9d78-2b388f3035fc admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 04 05:47:43.123455 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:47:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:43.320954 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-ddcbed50-f026-4d05-a5f0-b366f0e89188 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:43.327230 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.wsgi [None req-ddcbed50-f026-4d05-a5f0-b366f0e89188 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-ddcbed50-f026-4d05-a5f0-b366f0e89188 admin admin] Request method failure captured: Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Accept: application/json Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Accept-Encoding: gzip, deflate Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Connection: keep-alive Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Content-Length: 0 Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Host: 10.222.0.42 Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Openstack-Api-Version: compute 2.90 Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Openstack-System-Scope: None Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: User-Agent: python-novaclient Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Auth-Token: gAAAAABiwn7_sO003TE73G_tvE7vms5J-OL825iTnUyeOyP3u3QQRTLO4EUvmp6LrhHc_AKl-e8HnzqHpgQjxbP_1uKfvkX1XBt-vWR6sOG3v37ZGa_S-xpcM4FlJTjoAxsWQ9AzvogpLWwRN_hjF6tbXtsJMr4jOwPmaxpDWD4DUI9UNXcJPTY Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Domain-Id: None Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Domain-Name: None Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Identity-Status: Confirmed Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Is-Admin-Project: True Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Domain-Id: default Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Domain-Name: Default Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Name: admin Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Role: reader,member,admin Jul 04 05:47:43.328775 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Roles: reader,member,admin Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Tenant: admin Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Tenant-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Tenant-Name: admin Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User: admin Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Domain-Id: default Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Domain-Name: Default Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Id: 825e62d400e54cc0868912432c257354 Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Name: admin Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: method: > Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: exception: Flavor 84 could not be found. Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: action_args: {'id': '84'} Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:47:43.330260 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:43.331320 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:43.332682 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-ddcbed50-f026-4d05-a5f0-b366f0e89188 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:47:43.333942 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-ddcbed50-f026-4d05-a5f0-b366f0e89188 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065350 Jul 04 05:47:43.333942 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jul 4 05:47:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 05:47:43.340062 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-abe69874-411c-4632-aaa2-6fc8ad5382d5 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:43.353652 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-abe69874-411c-4632-aaa2-6fc8ad5382d5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017379 Jul 04 05:47:43.354193 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 4 05:47:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:47:43.363407 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-7d2b590f-aac0-40be-a0c9-b23f003c30c0 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:43.377026 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-7d2b590f-aac0-40be-a0c9-b23f003c30c0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017094 Jul 04 05:47:43.377594 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 4 05:47:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:47:43.392017 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-2398a10c-1c23-4064-87a2-a38b5e420917 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:43.401053 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.wsgi [None req-2398a10c-1c23-4064-87a2-a38b5e420917 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-2398a10c-1c23-4064-87a2-a38b5e420917 admin admin] Request method failure captured: Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Accept: application/json Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Accept-Encoding: gzip, deflate Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Connection: keep-alive Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Content-Length: 0 Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Host: 10.222.0.42 Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Openstack-Api-Version: compute 2.90 Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Openstack-System-Scope: None Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: User-Agent: python-novaclient Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Auth-Token: gAAAAABiwn7_sO003TE73G_tvE7vms5J-OL825iTnUyeOyP3u3QQRTLO4EUvmp6LrhHc_AKl-e8HnzqHpgQjxbP_1uKfvkX1XBt-vWR6sOG3v37ZGa_S-xpcM4FlJTjoAxsWQ9AzvogpLWwRN_hjF6tbXtsJMr4jOwPmaxpDWD4DUI9UNXcJPTY Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Domain-Id: None Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Domain-Name: None Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Identity-Status: Confirmed Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Is-Admin-Project: True Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Domain-Id: default Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Domain-Name: Default Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Name: admin Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Role: reader,member,admin Jul 04 05:47:43.402573 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Roles: reader,member,admin Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Tenant: admin Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Tenant-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Tenant-Name: admin Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User: admin Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Domain-Id: default Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Domain-Name: Default Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Id: 825e62d400e54cc0868912432c257354 Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Name: admin Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: method: > Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: exception: Flavor 84 could not be found. Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: action_args: {'id': '84'} Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:47:43.404093 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:43.405306 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:43.406540 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-2398a10c-1c23-4064-87a2-a38b5e420917 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:47:43.407791 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-2398a10c-1c23-4064-87a2-a38b5e420917 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.019940 Jul 04 05:47:43.407791 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jul 4 05:47:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 05:47:44.226786 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-7d2b590f-aac0-40be-a0c9-b23f003c30c0 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:44.227841 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-7d2b590f-aac0-40be-a0c9-b23f003c30c0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 04 05:47:44.228214 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:47:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:44.429992 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-f4e1d958-5d5f-43dd-b436-c0503fbf0412 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:44.438882 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.wsgi [None req-f4e1d958-5d5f-43dd-b436-c0503fbf0412 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-f4e1d958-5d5f-43dd-b436-c0503fbf0412 admin admin] Request method failure captured: Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Accept: application/json Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Accept-Encoding: gzip, deflate Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Connection: keep-alive Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Content-Length: 0 Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Host: 10.222.0.42 Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Openstack-Api-Version: compute 2.90 Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Openstack-System-Scope: None Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: User-Agent: python-novaclient Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Auth-Token: gAAAAABiwn8AfAeR8BQTv4HaBJyYTR_y16e14MSO6Z_IbB1wVaMNOGBrXUd49ekV6BRTs6yYjqBAYfBLHJhhiGJZKKcy2PGTm77ItfH08k-1YovjE-QIq-6Erk2yoPHDewXLT3UmwqWJJVFcBxLajALOHG1zQrLYN1W15fdX1szKVpmdsA4EDhs Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Domain-Id: None Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Domain-Name: None Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Identity-Status: Confirmed Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Is-Admin-Project: True Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Domain-Id: default Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Domain-Name: Default Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Project-Name: admin Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Role: reader,member,admin Jul 04 05:47:44.441171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Roles: reader,member,admin Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Tenant: admin Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Tenant-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-Tenant-Name: admin Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User: admin Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Domain-Id: default Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Domain-Name: Default Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Id: 825e62d400e54cc0868912432c257354 Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: X-User-Name: admin Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: method: > Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: exception: Flavor 451 could not be found. Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: action_args: {'id': '451'} Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:47:44.442592 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:44.443409 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: ERROR nova.api.openstack.wsgi Jul 04 05:47:44.444663 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-f4e1d958-5d5f-43dd-b436-c0503fbf0412 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:47:44.445935 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-f4e1d958-5d5f-43dd-b436-c0503fbf0412 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.077790 Jul 04 05:47:44.445935 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 4 05:47:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 05:47:44.452483 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-6372d409-8de1-486e-8a6d-fd49f81d084a admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:44.466366 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-6372d409-8de1-486e-8a6d-fd49f81d084a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017647 Jul 04 05:47:44.466890 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 4 05:47:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:47:44.476433 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:44.491729 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018854 Jul 04 05:47:44.492248 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 4 05:47:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:47:44.502593 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-2b457853-ad9f-4ab8-8c76-90b80b08feb9 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:44.510031 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.wsgi [None req-2b457853-ad9f-4ab8-8c76-90b80b08feb9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-2b457853-ad9f-4ab8-8c76-90b80b08feb9 admin admin] Request method failure captured: Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Accept: application/json Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Accept-Encoding: gzip, deflate Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Connection: keep-alive Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Content-Length: 0 Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Host: 10.222.0.42 Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Openstack-Api-Version: compute 2.90 Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Openstack-System-Scope: None Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: User-Agent: python-novaclient Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Auth-Token: gAAAAABiwn8AfAeR8BQTv4HaBJyYTR_y16e14MSO6Z_IbB1wVaMNOGBrXUd49ekV6BRTs6yYjqBAYfBLHJhhiGJZKKcy2PGTm77ItfH08k-1YovjE-QIq-6Erk2yoPHDewXLT3UmwqWJJVFcBxLajALOHG1zQrLYN1W15fdX1szKVpmdsA4EDhs Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Domain-Id: None Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Domain-Name: None Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Identity-Status: Confirmed Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Is-Admin-Project: True Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Domain-Id: default Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Domain-Name: Default Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Project-Name: admin Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Role: reader,member,admin Jul 04 05:47:44.511652 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Roles: reader,member,admin Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8a4d1bfa73f141cd90a91a1d9547a701"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Tenant: admin Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Tenant-Id: 8a4d1bfa73f141cd90a91a1d9547a701 Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-Tenant-Name: admin Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User: admin Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Domain-Id: default Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Domain-Name: Default Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Id: 825e62d400e54cc0868912432c257354 Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: X-User-Name: admin Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: method: > Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: exception: Flavor 451 could not be found. Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: action_args: {'id': '451'} Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:47:44.512977 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:44.513979 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: ERROR nova.api.openstack.wsgi Jul 04 05:47:44.515199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-2b457853-ad9f-4ab8-8c76-90b80b08feb9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:47:44.516324 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-2b457853-ad9f-4ab8-8c76-90b80b08feb9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014485 Jul 04 05:47:44.516324 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 4 05:47:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 05:47:45.339826 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:45.340828 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 04 05:47:45.341246 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:47:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:45.541559 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-70cc8ea6-7121-49d8-905b-02ae6925e82e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:45.562955 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-70cc8ea6-7121-49d8-905b-02ae6925e82e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.079128 Jul 04 05:47:45.563544 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jul 4 05:47:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:47:46.395399 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:46.396413 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 04 05:47:46.396805 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:47:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:46.590801 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-e69fb3cf-3259-41f1-a5ba-652145c43d24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:46.610672 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-e69fb3cf-3259-41f1-a5ba-652145c43d24 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.076447 Jul 04 05:47:46.611128 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jul 4 05:47:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:47:47.444839 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:47.445861 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005610 Jul 04 05:47:47.446252 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:47:47 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:47.648350 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-63424907-99d2-4bc9-9614-13149ba65a73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:47.668419 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-63424907-99d2-4bc9-9614-13149ba65a73 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.084986 Jul 04 05:47:47.668950 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jul 4 05:47:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 05:47:48.521684 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:48.522727 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 04 05:47:48.523123 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:47:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:48.721170 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-59fad730-4b84-4f0e-9c49-70002aeae8b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:47:48.742893 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-59fad730-4b84-4f0e-9c49-70002aeae8b2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.077644 Jul 04 05:47:48.743476 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jul 4 05:47:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:47:49.569589 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:49.570589 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 04 05:47:49.570984 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:47:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:47:49.768104 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-3f7965da-d30d-4b52-8622-ba54ae2d512e admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:47:49.787191 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-3f7965da-d30d-4b52-8622-ba54ae2d512e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076126 Jul 04 05:47:49.787757 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Mon Jul 4 05:47:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:48:36.678027 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:48:36.679024 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-ea222887-4848-4ca7-9651-c34df7d44222 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 04 05:48:36.679447 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 4 05:48:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:48:36.693441 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:36.742090 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-6842bb65-bbc6-457f-bfab-78ad16bc37c5 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:48:36.761361 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-6842bb65-bbc6-457f-bfab-78ad16bc37c5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074993 Jul 04 05:48:36.761962 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jul 4 05:48:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:48:36.785121 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-46e8252a-7ef7-4bf8-a34f-8be26654ff43 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:48:36.788508 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG dbcounter [-] [103127] Writing DB stats nova_api:SELECT=14 {{(pid=103127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:36.794013 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-46e8252a-7ef7-4bf8-a34f-8be26654ff43 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012591 Jul 04 05:48:36.794527 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Mon Jul 4 05:48:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:48:36.806237 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-a2ac120a-b818-4667-9380-a31254aff5f7 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:48:36.814954 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-a2ac120a-b818-4667-9380-a31254aff5f7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012491 Jul 04 05:48:36.815505 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Mon Jul 4 05:48:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:48:36.827090 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-f5885fa6-7cb7-4028-8a83-c061acd64366 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:48:36.835382 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-f5885fa6-7cb7-4028-8a83-c061acd64366 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011861 Jul 04 05:48:36.835900 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Mon Jul 4 05:48:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:48:36.847144 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-3406e307-e9e8-4a6a-8c61-5169ae005592 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:48:36.855333 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-3406e307-e9e8-4a6a-8c61-5169ae005592 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011686 Jul 04 05:48:36.855847 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Mon Jul 4 05:48:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:51:56.986191 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-f5885fa6-7cb7-4028-8a83-c061acd64366 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:51:56.987228 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-f5885fa6-7cb7-4028-8a83-c061acd64366 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 04 05:51:56.987637 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:51:57.129059 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writing DB stats nova_api:SELECT=6 {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:51:57.255783 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-c1f806aa-3a23-4e53-807e-1665fa45960f admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:51:57.256957 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:51:57.256957 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: warnings.warn(msg) Jul 04 05:51:57.258154 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-c1f806aa-3a23-4e53-807e-1665fa45960f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:51:57.258619 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-c1f806aa-3a23-4e53-807e-1665fa45960f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:51:57.259418 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-c1f806aa-3a23-4e53-807e-1665fa45960f admin admin] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:51:57.259845 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-c1f806aa-3a23-4e53-807e-1665fa45960f admin admin] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:51:57.292895 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-c1f806aa-3a23-4e53-807e-1665fa45960f admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.166551 Jul 04 05:51:57.293465 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 4 05:51:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:51:58.142676 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-f5885fa6-7cb7-4028-8a83-c061acd64366 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:51:58.144272 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-f5885fa6-7cb7-4028-8a83-c061acd64366 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002215 Jul 04 05:51:58.144794 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:51:58.352386 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-33661b3c-22f2-46d3-9479-c2473666081d admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:51:58.353557 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:51:58.353557 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: warnings.warn(msg) Jul 04 05:51:58.354741 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-33661b3c-22f2-46d3-9479-c2473666081d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:51:58.355177 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-33661b3c-22f2-46d3-9479-c2473666081d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:51:58.355994 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-33661b3c-22f2-46d3-9479-c2473666081d admin admin] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:51:58.356383 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-33661b3c-22f2-46d3-9479-c2473666081d admin admin] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:51:58.375974 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-33661b3c-22f2-46d3-9479-c2473666081d admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085642 Jul 04 05:51:58.376523 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 4 05:51:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:52:09.636915 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-f5885fa6-7cb7-4028-8a83-c061acd64366 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:52:09.638450 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-f5885fa6-7cb7-4028-8a83-c061acd64366 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002243 Jul 04 05:52:09.639103 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:52:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:52:09.795144 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writing DB stats nova_cell0:SELECT=4 {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:52:09.795893 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writing DB stats nova_cell1:SELECT=4 {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:52:09.796498 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG dbcounter [-] [103126] Writing DB stats nova_api:SELECT=8 {{(pid=103126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:52:09.855630 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-edc4f275-6aca-4146-88de-3fac3fc40440 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:52:09.856807 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:52:09.856807 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: warnings.warn(msg) Jul 04 05:52:09.858033 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-edc4f275-6aca-4146-88de-3fac3fc40440 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:52:09.858502 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-edc4f275-6aca-4146-88de-3fac3fc40440 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:52:09.859288 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-edc4f275-6aca-4146-88de-3fac3fc40440 admin admin] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:52:09.859732 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-edc4f275-6aca-4146-88de-3fac3fc40440 admin admin] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:52:09.884426 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-edc4f275-6aca-4146-88de-3fac3fc40440 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093907 Jul 04 05:52:09.884975 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 4 05:52:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:52:10.729171 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: DEBUG nova.api.openstack.wsgi [None req-f5885fa6-7cb7-4028-8a83-c061acd64366 admin admin] Calling method '>' {{(pid=103127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:52:10.730174 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: INFO nova.api.openstack.requestlog [None req-f5885fa6-7cb7-4028-8a83-c061acd64366 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jul 04 05:52:10.730564 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: [pid: 103127|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 4 05:52:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:52:10.935278 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG nova.api.openstack.wsgi [None req-79ecd276-39d8-4721-a0a3-e81099c8c060 admin admin] Calling method '>' {{(pid=103126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:52:10.936465 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:52:10.936465 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: warnings.warn(msg) Jul 04 05:52:10.937649 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-79ecd276-39d8-4721-a0a3-e81099c8c060 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:52:10.938081 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-79ecd276-39d8-4721-a0a3-e81099c8c060 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:52:10.938885 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-79ecd276-39d8-4721-a0a3-e81099c8c060 admin admin] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:52:10.939336 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: DEBUG oslo_concurrency.lockutils [None req-79ecd276-39d8-4721-a0a3-e81099c8c060 admin admin] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:52:10.960657 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: INFO nova.api.openstack.requestlog [None req-79ecd276-39d8-4721-a0a3-e81099c8c060 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086809 Jul 04 05:52:10.961199 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: [pid: 103126|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 4 05:52:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:53:06.625158 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: Mon Jul 4 05:53:06 2022 - graceful shutdown triggered... Jul 04 05:53:06.625254 dv-cinder-797333-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 04 05:53:06.626323 dv-cinder-797333-5-iscsi devstack@n-api.service[103126]: Gracefully killing worker 1 (pid: 103126)... Jul 04 05:53:06.626916 dv-cinder-797333-5-iscsi devstack@n-api.service[103127]: Gracefully killing worker 2 (pid: 103127)... Jul 04 05:53:07.627615 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: worker 1 buried after 1 seconds Jul 04 05:53:07.627615 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: worker 2 buried after 1 seconds Jul 04 05:53:07.627615 dv-cinder-797333-5-iscsi devstack@n-api.service[103125]: goodbye to uWSGI. Jul 04 05:53:07.629825 dv-cinder-797333-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 04 05:53:07.630649 dv-cinder-797333-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 04 05:53:07.634807 dv-cinder-797333-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 05:53:07.648991 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 05:53:07.651825 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 05:53:07 2022] *** Jul 04 05:53:07.651825 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 05:53:07.651825 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 05:53:07.651825 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: nodename: dv-cinder-797333-5-iscsi Jul 04 05:53:07.651825 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: machine: x86_64 Jul 04 05:53:07.651825 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: clock source: unix Jul 04 05:53:07.651825 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: pcre jit disabled Jul 04 05:53:07.651825 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: detected number of CPU cores: 4 Jul 04 05:53:07.651825 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: current working directory: / Jul 04 05:53:07.651825 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: detected binary path: /usr/bin/uwsgi-core Jul 04 05:53:07.651825 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: your processes number limit is 47680 Jul 04 05:53:07.653175 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: your memory page size is 4096 bytes Jul 04 05:53:07.653175 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: detected max file descriptor number: 2048 Jul 04 05:53:07.653175 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: lock engine: pthread robust mutexes Jul 04 05:53:07.653175 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: thunder lock: enabled Jul 04 05:53:07.653175 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 05:53:07.653175 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 05:53:07.699881 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: Python main interpreter initialized at 0x5623e29f69c0 Jul 04 05:53:07.699881 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: python threads support enabled Jul 04 05:53:07.699881 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: your server socket listen backlog is limited to 100 connections Jul 04 05:53:07.699881 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: your mercy for graceful operations on workers is 90 seconds Jul 04 05:53:07.700345 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 05:53:07.700345 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: *** Operational MODE: preforking *** Jul 04 05:53:07.700593 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: *** uWSGI is running in multiple interpreter mode *** Jul 04 05:53:07.700593 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: spawned uWSGI master process (pid: 117591) Jul 04 05:53:07.700817 dv-cinder-797333-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 05:53:07.703017 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: spawned uWSGI worker 1 (pid: 117606, cores: 1) Jul 04 05:53:07.703017 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: spawned uWSGI worker 2 (pid: 117607, cores: 1) Jul 04 05:53:07.703017 dv-cinder-797333-5-iscsi devstack@n-api.service[117591]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 05:53:08.362485 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 05:53:08.364046 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 05:53:09.547279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:53:09.547279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: from cryptography.utils import int_from_bytes Jul 04 05:53:09.547910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:53:09.547910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: from cryptography.utils import int_from_bytes Jul 04 05:53:09.552031 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:53:09.552031 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: from cryptography.utils import int_from_bytes Jul 04 05:53:09.552570 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:53:09.552570 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: from cryptography.utils import int_from_bytes Jul 04 05:53:11.922735 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 05:53:11.923727 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 05:53:11.924274 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 05:53:11.924633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 05:53:11.924878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 05:53:11.925267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.925626 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.925930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.926228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.926561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.926872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.927204 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.927542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.928216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.928480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.928803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.929155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797333-5-iscsi {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.929494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.929752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.930097 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.930396 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.930702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.930872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 05:53:11.931420 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.931519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 05:53:11.931600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.931678 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 05:53:11.931848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.932045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 05:53:11.932278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 05:53:11.932666 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.933205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.933605 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.934046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.934475 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.934890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.935276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.935508 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.935725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.935949 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.936171 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.936384 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.936600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.936812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.937024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.937245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.937481 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.937695 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.937910 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.938113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.938325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797333-5-iscsi {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.938544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.938758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.938758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.939108 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797333-5-iscsi {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.939304 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.939469 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.939619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.939803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.939957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.940129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.940272 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.940453 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.940599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.940746 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.940898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.941064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.941222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.941363 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.941511 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.941663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.941833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.941984 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.943089 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.943292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.943455 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.943606 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.943750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.943897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.944128 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.944292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.944498 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.944656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.944807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.944956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.945107 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.945249 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.945249 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.945532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797333-5-iscsi {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.945681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.945875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.946032 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.946183 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.946324 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.946466 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.946631 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.946780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.946929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.947078 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.947219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.947388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.947549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.947743 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.947897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.948049 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.948190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.948342 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.948495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.948672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.948829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.948829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.949119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.949278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.949420 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.949562 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.949713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.949865 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.950012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.950167 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.950320 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.950461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.950609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.950750 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.950907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.951062 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.951212 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.951398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.951549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.951691 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.951849 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.951999 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.952147 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.952465 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.952975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.953289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.953454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.953606 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.953749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.953749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.954035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.954293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.954442 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.954631 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.954797 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.954940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.955082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.955233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.955413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.955565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.955715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.955865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.956007 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.956162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.956305 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.956453 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.957136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.957233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.957322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.957414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.957489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.957569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.957649 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.957721 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.957828 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.957907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.957987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958131 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958201 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958360 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958432 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958664 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958754 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.958994 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959067 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959145 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959226 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959732 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959882 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.959961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960123 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960272 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960581 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960731 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960803 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.960953 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961172 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961252 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961324 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961722 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961882 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.961954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.962039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.962139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.962224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.962303 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.962382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.962473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.962552 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.962638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.963325 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.963457 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.963569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.963693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.963811 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.963940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.964052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.964170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.964287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.964409 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.964520 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.964645 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.964769 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.964891 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.965014 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.965144 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.965275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.965404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.965524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.965642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.965762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.965892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.966005 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.966122 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.966430 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.966637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.966772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.966893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.967004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.967114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.967262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.967468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.967600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.967780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.968085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.968403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.968633 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.968748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.969058 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.969611 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.969820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.969973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.970127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.970289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.970444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.970608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.970772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.970925 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.971079 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.971234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.971421 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.971566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.971719 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.972152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.972318 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.972476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.972628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.972772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.972935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.973087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.973240 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.973384 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.973384 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.973666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.973808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.973960 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.974103 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.974246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.974395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.974538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.974688 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.974862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.975017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.975168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.975369 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.975526 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.975678 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.975831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.975990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.976141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.976284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:53:11.976435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.976578 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.976729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.976884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.977028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.977178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.977329 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.977329 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.977630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.977784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.977937 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.978109 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.978748 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.979077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.979225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.979415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.979571 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.979723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.979877 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.980030 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.980190 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.980335 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.980478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.980628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.980779 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.980923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.981076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.981220 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.981381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.981533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.981688 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.981839 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.981992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.982144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.982287 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.982445 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.982597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.982740 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.982892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.983035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.983179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.983386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.983540 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.983694 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.983852 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.984007 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.984153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.984303 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.984454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.984607 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.984766 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.984920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.985073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.985229 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.985437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.985605 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.985758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.985910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.986063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.986208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.986358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.986511 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.986655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.986809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.986962 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.987106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.987305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.987467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.987612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.987755 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.987905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.988056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.988216 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.988853 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.989203 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.989357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.989501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.989653 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.989813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.989978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.990123 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.990267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.990419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.990572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.990731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.990885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.991038 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.991184 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.991370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.991530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.991683 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.991827 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.991988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.992140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.992293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.992448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.992611 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.992755 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.992906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.993050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.993201 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.993360 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.993514 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.993659 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.993803 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.993964 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.994117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.994270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.994422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.994573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.994733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.994882 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.995111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.995289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.995439 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.995582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.995725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.995889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.996048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.996193 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.996344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.996488 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.996631 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.996782 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.996934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.997086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.997238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.997389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.997542 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.997702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.997876 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.998029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.998174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.998316 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.998485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.999093 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.999466 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.999640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.999786 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:11.999930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.000073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.000226 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.000371 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.000524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.000668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.000811 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.000982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.001149 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.001295 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.001445 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.001590 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.001739 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.001920 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.002095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.002248 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.002392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.002554 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.002699 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.002852 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.002997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.003140 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.003324 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.003489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.003634 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.003786 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.003930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.004074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.004224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.004384 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.004528 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.004685 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.004845 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.004997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.005141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.005293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.005443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.005602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.005755 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.005898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.006048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.006199 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.006361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.006506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.006648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.006790 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.006932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.007081 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.007239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.007432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.007588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.007732 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.007873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.008016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.008167 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.008322 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.008465 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.009141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.009310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.009666 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.009827 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.009982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.010134 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.010292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.010438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.010588 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.010746 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.010898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.011064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.011209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.011429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.011590 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.011742 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.011893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.012842 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.013008 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.013162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.013314 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.013460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.013616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.013775 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.013920 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.014071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.014214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.014356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.014508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.014658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.014804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.014948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.015090 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.015233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.015428 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.015585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.015729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.015871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.016023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.016175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.016329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.016473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.016675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.016835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.016981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.016981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.017266 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.017423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.017573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.017726 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.017877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.018034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.018179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.018179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.018475 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.018618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.018787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.019542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.019905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.020056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.020213 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.020356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.020499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.020656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.020809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.020961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.021105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.021247 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.021390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.021555 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.021710 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.021862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.022015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.022170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.022323 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.022467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.022609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.022751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.022993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.023143 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.023366 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.023518 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.023670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.023831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.023978 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.024129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.024293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.024437 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.024579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.024730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.024882 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.025035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.025193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.025338 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.025487 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.025630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.025780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.025931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.026162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.026326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.026471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.026614 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.026763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.026921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.027065 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.027216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.027402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.027555 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.027698 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.027854 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.028003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.028003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.028291 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.028433 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.028575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.028731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.028883 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.028987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.029362 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.029362 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.029715 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.029813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.029914 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.030188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.030285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.030380 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.030474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.030566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.030660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.030745 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.030831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.030922 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.031016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.031117 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.031212 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.031361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.031450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.031537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.031643 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.031732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.031827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.031914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.031997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.032088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.032182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.032315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.032413 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.032501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.032584 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.032676 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.032761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.032761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.032922 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.033007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.033097 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.033243 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.033341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.033435 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.033527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.033619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.033705 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.033802 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.033896 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.033980 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.034063 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.034147 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.034229 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.034325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.034433 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.034528 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.034629 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.034724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.034809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.034893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.034982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.035073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.035172 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.035280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.035368 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.035451 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.035547 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.035644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.035737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.035822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.035905 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.035988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.036079 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.036173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.036258 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.036341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.036430 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.036515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.036606 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.036700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.036792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.036884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.036968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037059 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037315 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037409 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037578 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037758 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037836 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.037986 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.038065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.038151 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.038230 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.038303 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.038374 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.038525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.038616 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.038710 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.038795 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.038878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.038878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.039049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.039049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.039209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.039360 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.039635 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.039735 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.039831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.039968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.040101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.040299 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.040398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.040575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.040695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.040877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.040982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.041190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.041285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.041499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.041592 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.041803 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.041903 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.042112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.042213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.042410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.042503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.042716 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.042818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.043011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.043122 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.043346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.043442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.043651 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.043743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.043951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.044059 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.044249 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.044349 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.044548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.044641 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.044851 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.044951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.045155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.045247 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.045465 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.045565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.045773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.045867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.046076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.046177 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.046387 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.046479 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.046687 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.046788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.047006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.047102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.047323 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.047474 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.047625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.047728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.047960 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.048059 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.048260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.048351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.048566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.048661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.048864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.048956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.049171 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.049276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.049477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.049597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.049782 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.049924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.050080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.050188 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.050397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.050501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.050675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.050768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.050974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.051076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.051297 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.051393 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.051606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.051699 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.051914 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.052021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.052215 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.052347 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.052520 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.052640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.053170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.053300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.053471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.053588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.053771 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.053897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.054069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.054196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.054368 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.054501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.054682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.054841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.054975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.055143 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.055337 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.055467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.055589 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.055763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.055975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.056091 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.056204 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.056356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.056485 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.056752 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.056981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.057282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.057582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.057889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.058007 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.058188 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.058350 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.058488 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.058717 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.058818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.059039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.059141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.059445 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.059578 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.059816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.059934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.060129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.060251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061736 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.061975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.062120 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.062225 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.062420 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.062537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.062729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.062849 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.063046 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.063161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.063374 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.063574 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.063769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.064138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.064228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.064329 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.064423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.064523 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.064681 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.064826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.064979 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.065156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.065333 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.065464 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.065638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.065776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.065948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.066090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.066264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.066402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.066574 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.066715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.066882 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.067026 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.067193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.067369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.067519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.067689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.067833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.068007 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.068142 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.068324 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.068450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.068637 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.068751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.068946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.069054 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.069259 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.069365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.069573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.069675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.069883 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.069990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.070208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.070419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.070571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.070741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.070838 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.071110 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.071279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.071387 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.071483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.071675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.071768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.071984 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.072077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.072292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.072456 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.072600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.072769 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.072905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.073083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.073215 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.073393 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.073523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.073707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.073833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.074018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.074142 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.074337 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.074438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.074655 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.074753 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.074965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.075057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.075352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.075461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.075659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.075761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.075979 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.076073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.076284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.076391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.076584 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.076678 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.076887 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.076979 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.077185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.077292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.077490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.077582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.077790 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.077890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.078113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.078214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.078423 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.078516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.078748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.078841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.079055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.079181 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.079429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.079524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.079735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.079839 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.080047 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.080140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.080358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.080506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.080693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.080846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.081054 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.081191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.081378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.081479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.081653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.081756 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.081959 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.082075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.082258 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.082399 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.082559 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.082707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.082866 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.083024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.083183 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.083360 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.083508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.083689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.083795 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.084014 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.084116 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.084326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.084419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.084646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.084739 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.084955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.085048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.085282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.085428 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.085598 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.085696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.085913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.086135 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.086238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.086547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.086642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.086855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.086948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.087161 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.087288 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.087512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.087607 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.087828 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.087923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.088148 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.088254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.088447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.088548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.088756 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.088850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.089060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.089165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.089373 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.089464 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.089691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.089781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.089996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.090089 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.090305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.090397 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.090606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.090719 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.090918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.091029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.091221 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.091335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.091554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.091658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.091873 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.091972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.092178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.092269 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.092506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.092614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.092822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.092922 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.093148 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.093249 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.093475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.093577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.093780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.093878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.094082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.094183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.094391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.094496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.094691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.094832 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.095042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.095135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.095374 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.095489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.095723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.095818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.096034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.096126 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.096341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.096434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.096645 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.096746 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.096946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.097046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.097244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.097346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.097560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.097657 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.097858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.097959 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.098174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.098274 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.098482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.098574 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.098797 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.098889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.099112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.099212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.099451 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.099549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.099769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.099875 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.100072 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.100163 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.100369 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.100460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.100669 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.100772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.100968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.101062 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.101270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.101362 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.101580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.101776 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.101872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.102080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.102188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.102411 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.102504 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.102740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.102842 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.103047 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.103140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.103400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.103511 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.103704 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.103805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.104006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.104102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.104340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.104441 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.104644 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.104736 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.104955 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.105046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.105258 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.105369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.105572 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.105666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.105875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.106021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.106176 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.106278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.106476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.106570 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.106781 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.106875 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.107083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.107186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.107418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.107522 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.107722 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.107824 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.108041 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.108141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.108342 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.108436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.108654 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.108754 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.108956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.109049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.109256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.109356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.109555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.109647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.109853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.109947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.110191 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.110427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.110524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.110757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.110858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.111075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.111172 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.111412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.111549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.111729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.111844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.112046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.112153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.112355 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.112450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.112666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.112761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.112973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.113066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.113282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.113381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.113592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.113684 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.113901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.113995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.114211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.114340 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.114519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.114623 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.114822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.114925 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.115132 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.115235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.115477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.115583 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.115790 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.115883 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.116101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.116321 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.116461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.116645 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.116776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.117005 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.117110 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.117390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.117491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.117708 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.117836 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.118020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.118121 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.118330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.118431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.118634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.118726 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.118938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.119039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.119260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.119358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.119566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.119661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.119876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.119975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.120189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.120282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.120502 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.120603 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.120826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.120926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.121135 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.121277 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.121447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.121597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.121756 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.121866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.122114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.122218 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.122370 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.122480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.122699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.122888 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.123002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.123204 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.123335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.123563 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.123658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.123895 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.123989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.124219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.124327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.124524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.124624 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.124834 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.124927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.125140 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.125246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.125448 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.125542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.125751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.125844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.126105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.126210 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.126416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.126515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.126722 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.126852 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.127046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.127150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.127383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.127491 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.127692 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.127827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.128000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.128103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.128311 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.128410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.128821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.128913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.129136 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.129236 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.129466 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.129566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.129791 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.129894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.130113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.130214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.130426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.130526 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.130732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.130836 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.131058 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.131149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.131383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.131477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.131687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.131832 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.131997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.132252 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.132353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.132439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.132604 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.132711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.132912 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.133080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.133224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.133391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.133535 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.133692 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.133841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.134010 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.134154 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.134316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.134459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.134789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.134881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.135098 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.135207 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.135432 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.135541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.135739 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.135840 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.136055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.136155 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.136361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.136531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.136667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.136768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.136976 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.137075 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.137288 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.137391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.137600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.137692 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.137903 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.138040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.138212 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.138313 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.138512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.138614 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.138814 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.138915 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.139118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.139218 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.139445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.139548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.139747 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.139847 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.140053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.140146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.140354 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.140456 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.140679 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.140778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.140981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.141073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.141280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.141381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.141647 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.141790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.141910 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.142003 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.142188 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.142356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.142530 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.142685 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.142808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.142921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.143065 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.143398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.143494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.143699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.143793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.144004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.144104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.144303 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.144397 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.144609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.144711 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.144908 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.145001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.145216 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.145322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.145566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.145660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.145885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.145978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.146187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.146293 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.146488 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.146588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.146797 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.146889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.147103 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.147208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.147442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.147548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.147751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.147845 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.148058 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.148204 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.148369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.148567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.148662 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.148884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.148987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.149277 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.149409 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.149592 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.149741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.149904 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.150060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.150223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.150390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.150568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.150718 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.150888 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.151025 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.151206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.151352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.151551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.151648 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.151870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.151998 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.152181 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.152283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.152495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.152602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.152809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.152923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.153119 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.153219 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.153429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.153520 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.153737 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.153839 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.154042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.154135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.154349 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.154452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.154656 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.154852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.154946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.155169 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.155289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.155514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.155618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.155834 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.155927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.156144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.156247 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.156469 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.156577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.156791 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.156889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.157105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.157230 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.157470 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.157565 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.157780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.157878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.158088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.158189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.158398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.158497 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.158706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.158799 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.159017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.159118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.159367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.159463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.159695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.159791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.159998 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.160098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.160301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.160394 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.160618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.160794 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.160932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.161108 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.161238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.161426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.161597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.161749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.161861 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.162058 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.162154 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.162377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.162520 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.162698 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.162803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.163007 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.163108 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.163341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.163448 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.163650 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.163744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.163957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.164157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.164251 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.164498 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.164604 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.164831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.164948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.165138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.165247 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.165447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.165620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.165750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.165841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.166050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.166149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.166353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.166447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.166655 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.166745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.166957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.167051 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.167274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.167369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.167575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.167668 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.167881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.167985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.168183 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.168276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.168484 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.168580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.168785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.168879 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.169087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.169187 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.169396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.169497 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.169694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.169797 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.169997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.170090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.170296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.170389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.170595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.170696 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.170895 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.170997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.171195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.171925 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.172067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.172192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.172313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.172408 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.172501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.172633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.172816 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.172950 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.173085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.173187 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.173274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.173358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.173452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.173570 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.173671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.173898 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.173993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.174216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.174324 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.174528 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.174620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.174841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.174940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.175150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.175281 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.175490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.175628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.175810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.175901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.176119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.176211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.176427 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.176520 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.176733 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.176824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.177043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.177137 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.177348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.177439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.177655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.178088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.178301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.178395 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.178606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.178703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.178913 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.179005 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.179235 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.179401 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.179585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.179760 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.179935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.180067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.180246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.180389 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.180597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.180697 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.180928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.181033 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.181243 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.181373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.181554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.181683 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.182270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.182389 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.182510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 05:53:12.182622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.182622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.182830 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.183132 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.183423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.183722 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.184110 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.184505 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.184846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.185149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.185473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.185794 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.186139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.186453 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.186795 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.187117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.187463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.187775 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.188078 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:53:12.188318 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 05:53:12.246774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] Registered counter for database nova_api Jul 04 05:53:12.250515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] Registered counter for database nova_api Jul 04 05:53:12.268590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:53:12.270961 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:53:12.275590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:53:12.277818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:53:12.334947 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.context [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b04425d4-b271-4f52-96b4-9703962c8b23(cell1) {{(pid=117607) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 05:53:12.336550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.context [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b04425d4-b271-4f52-96b4-9703962c8b23(cell1) {{(pid=117606) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 05:53:12.340187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:53:12.341799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:53:12.342595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:53:12.344017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:53:12.344586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:53:12.346890 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] Registered counter for database nova_cell0 Jul 04 05:53:12.347464 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:53:12.349022 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:53:12.351029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] Registered counter for database nova_cell1 Jul 04 05:53:12.351849 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:53:12.353947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] Registered counter for database nova_cell0 Jul 04 05:53:12.358162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] Registered counter for database nova_cell1 Jul 04 05:53:12.358474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:53:12.360275 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:53:12.365865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:53:12.366234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:53:12.368309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:53:12.368430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:53:12.374535 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:53:12.375880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:53:12.512995 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] Registered counter for database nova_cell0 Jul 04 05:53:12.520343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:53:12.522658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] Registered counter for database nova_cell0 Jul 04 05:53:12.525548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:53:12.529691 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:53:12.534286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:53:12.841732 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 05:53:12.849343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 05:53:12.857110 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 05:53:12.864543 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 05:53:13.195119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 05:53:13.201365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-292dc939-ade5-4fec-9a70-c78c9bb340b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 05:53:13.206780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623e29f69c0 pid: 117607 (default app) Jul 04 05:53:13.209306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 05:53:13.215458 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-55ae6e90-699c-48ca-aef0-6b99893d35da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 05:53:13.220825 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623e29f69c0 pid: 117606 (default app) Jul 04 05:53:54.018167 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:53:54.019073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:53:54.020286 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:53:54.021573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:53:54.190269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:53:54.198675 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:53:54.201280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:53:54.202280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:53:55.584985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3cb3dc72-97be-4f6a-bec1-9ed654186a0c tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Action: 'create', calling method: .version_select at 0x7f204d63e700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-670504042"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:53:55.763126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f64dd68-9001-475c-be51-c385e46c3df7 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Action: 'create', calling method: .version_select at 0x7f204d63f700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1180776789", "metadata": {"Type": "work"}}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f64dd68-9001-475c-be51-c385e46c3df7 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Request method failure captured: Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 122 Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoBy1geTcxo-AUghWoarQez0S9VL-QV8RECadFr6CXC1GdssELtDg0c509pY1LyUeAvTe98-Qvv-0d138sCfZ9cZUOSTiUR9ZmeDqkYXN6kHrDdQUK3BvJ3sQ_YR8nAfvCrfeYlCXC8mNWbvEfnJTFSpElAex2cvW9cn9OFf-iSOx0k Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 05:53:55.787858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 80c7837783194f5b8db43da205c80f2c Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1180776789", "metadata": {"Type": "work"}}} Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: Jul 04 05:53:55.789585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1180776789', 'metadata': {'Type': 'work'}}}} Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise error Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi '#$%' Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:53:55.790557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 05:53:55.792175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 05:53:55.793618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 05:53:55.793618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:53:55.794893 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f64dd68-9001-475c-be51-c385e46c3df7 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:53:55.796076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8f64dd68-9001-475c-be51-c385e46c3df7 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.611192 Jul 04 05:53:55.797364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Jul 4 05:53:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1614 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 05:53:56.015008 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f3cd7302-1c93-400b-853d-0f911e370d41 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] Action: 'create', calling method: .version_select at 0x7f204d5c19d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-671277262", "metadata": {"Type": "work"}}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:53:56.830654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3cb3dc72-97be-4f6a-bec1-9ed654186a0c tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.826857 Jul 04 05:53:56.832620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1/2] 10.222.0.42 () {60 vars in 1154 bytes} [Mon Jul 4 05:53:54 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2831 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 04 05:53:56.839989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0d2755f-2651-4dd5-8f4c-31ca4c013558 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Action: 'create', calling method: .version_select at 0x7f204d5044c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1641243857", "metadata": {"Type": "work"}}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0d2755f-2651-4dd5-8f4c-31ca4c013558 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Request method failure captured: Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 120 Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoBy1geTcxo-AUghWoarQez0S9VL-QV8RECadFr6CXC1GdssELtDg0c509pY1LyUeAvTe98-Qvv-0d138sCfZ9cZUOSTiUR9ZmeDqkYXN6kHrDdQUK3BvJ3sQ_YR8nAfvCrfeYlCXC8mNWbvEfnJTFSpElAex2cvW9cn9OFf-iSOx0k Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:53:56.848767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 80c7837783194f5b8db43da205c80f2c Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1641243857", "metadata": {"Type": "work"}}} Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: Jul 04 05:53:56.851742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1641243857', 'metadata': {'Type': 'work'}}}} Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise error Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi '0' Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:53:56.852819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 05:53:56.854255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 05:53:56.855770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 05:53:56.855770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:56.859894 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0d2755f-2651-4dd5-8f4c-31ca4c013558 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:53:56.861369 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c0d2755f-2651-4dd5-8f4c-31ca4c013558 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027080 Jul 04 05:53:56.861975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Jul 4 05:53:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 05:53:56.884336 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8dc6873f-22f0-4120-b0e8-33a83b7ba9f7 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d5044c0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:57.066072 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8dc6873f-22f0-4120-b0e8-33a83b7ba9f7 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764" status: 200 len: 344 microversion: 2.1 time: 0.195698 Jul 04 05:53:57.071141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:53:56 2022] GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:53:57.072161 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d4ad96c9-a92e-4f05-8231-aa48b5128cb2 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Action: 'create', calling method: .version_select at 0x7f204d5043a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1545893720", "metadata": {"Type": "work"}}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d4ad96c9-a92e-4f05-8231-aa48b5128cb2 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Request method failure captured: Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 119 Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoBy1geTcxo-AUghWoarQez0S9VL-QV8RECadFr6CXC1GdssELtDg0c509pY1LyUeAvTe98-Qvv-0d138sCfZ9cZUOSTiUR9ZmeDqkYXN6kHrDdQUK3BvJ3sQ_YR8nAfvCrfeYlCXC8mNWbvEfnJTFSpElAex2cvW9cn9OFf-iSOx0k Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:53:57.078138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 80c7837783194f5b8db43da205c80f2c Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1545893720", "metadata": {"Type": "work"}}} Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: Jul 04 05:53:57.079845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1545893720', 'metadata': {'Type': 'work'}}}} Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise error Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi '' Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:53:57.080861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 05:53:57.082356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 05:53:57.084021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 05:53:57.084021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.084021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d4ad96c9-a92e-4f05-8231-aa48b5128cb2 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:53:57.084021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d4ad96c9-a92e-4f05-8231-aa48b5128cb2 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011783 Jul 04 05:53:57.084021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 4/5] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Jul 4 05:53:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 05:53:57.096459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-01031b54-c460-4d47-95aa-c7975de12151 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Calling method '.version_select at 0x7f204d4b5ee0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:57.167114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-01031b54-c460-4d47-95aa-c7975de12151 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] HTTP exception thrown: Volume tempest-invalid-1787504573 could not be found. Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-01031b54-c460-4d47-95aa-c7975de12151 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Request method failure captured: Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1787504573 HTTP/1.1 Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoBy1geTcxo-AUghWoarQez0S9VL-QV8RECadFr6CXC1GdssELtDg0c509pY1LyUeAvTe98-Qvv-0d138sCfZ9cZUOSTiUR9ZmeDqkYXN6kHrDdQUK3BvJ3sQ_YR8nAfvCrfeYlCXC8mNWbvEfnJTFSpElAex2cvW9cn9OFf-iSOx0k Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:53:57.171729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 80c7837783194f5b8db43da205c80f2c Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Volume tempest-invalid-1787504573 could not be found. Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': 'tempest-invalid-1787504573'} Jul 04 05:53:57.173185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1787504573 could not be found. (HTTP 404) (Request-ID: req-ced26b25-722e-4353-8e52-14703aa6e4df) Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:57.173997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 05:53:57.175189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1787504573 could not be found. Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:53:57.178981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1787504573 could not be found. Jul 04 05:53:57.181638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.181638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:57.181638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.181638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.181638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:57.181638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:57.181638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:53:57.181638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:53:57.181638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1787504573 could not be found. Jul 04 05:53:57.181638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.184377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-01031b54-c460-4d47-95aa-c7975de12151 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Returning 404 to user: Volume tempest-invalid-1787504573 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:53:57.185698 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-01031b54-c460-4d47-95aa-c7975de12151 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1787504573" status: 404 len: 99 microversion: 2.1 time: 0.098333 Jul 04 05:53:57.186930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 5/6] 10.222.0.42 () {58 vars in 1217 bytes} [Mon Jul 4 05:53:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1787504573 => generated 99 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 04 05:53:57.196211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bdc56e65-b55f-4bd7-b6b2-0fc4cea35097 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004184 Jul 04 05:53:57.197123 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 6/7] 10.222.0.42 () {58 vars in 1139 bytes} [Mon Jul 4 05:53:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 04 05:53:57.207229 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dbef8d52-5a9c-457c-bdd1-ffdc48cf9c6d tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004893 Jul 04 05:53:57.208594 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 7/8] 10.222.0.42 () {58 vars in 1136 bytes} [Mon Jul 4 05:53:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 04 05:53:57.220065 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a455c478-1198-44ed-a1ae-76b0891d0c41 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Calling method '.version_select at 0x7f204d49f550>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:57.401502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-a455c478-1198-44ed-a1ae-76b0891d0c41 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] HTTP exception thrown: Volume e562ac37-6336-4f95-ba94-f3615dce12c3 could not be found. Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a455c478-1198-44ed-a1ae-76b0891d0c41 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Request method failure captured: Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/os-volumes/e562ac37-6336-4f95-ba94-f3615dce12c3 HTTP/1.1 Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoBy1geTcxo-AUghWoarQez0S9VL-QV8RECadFr6CXC1GdssELtDg0c509pY1LyUeAvTe98-Qvv-0d138sCfZ9cZUOSTiUR9ZmeDqkYXN6kHrDdQUK3BvJ3sQ_YR8nAfvCrfeYlCXC8mNWbvEfnJTFSpElAex2cvW9cn9OFf-iSOx0k Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:53:57.403668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 80c7837783194f5b8db43da205c80f2c Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Volume e562ac37-6336-4f95-ba94-f3615dce12c3 could not be found. Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': 'e562ac37-6336-4f95-ba94-f3615dce12c3'} Jul 04 05:53:57.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e562ac37-6336-4f95-ba94-f3615dce12c3 could not be found. (HTTP 404) (Request-ID: req-4eea1c52-f4f1-4765-8d85-dcc1085fa31c) Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:57.405822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 05:53:57.406889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e562ac37-6336-4f95-ba94-f3615dce12c3 could not be found. Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 05:53:57.408098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e562ac37-6336-4f95-ba94-f3615dce12c3 could not be found. Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e562ac37-6336-4f95-ba94-f3615dce12c3 could not be found. Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a455c478-1198-44ed-a1ae-76b0891d0c41 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Returning 404 to user: Volume e562ac37-6336-4f95-ba94-f3615dce12c3 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a455c478-1198-44ed-a1ae-76b0891d0c41 tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e562ac37-6336-4f95-ba94-f3615dce12c3" status: 404 len: 109 microversion: 2.1 time: 0.191672 Jul 04 05:53:57.409812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 8/9] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jul 4 05:53:57 2022] DELETE /compute/v2.1/os-volumes/e562ac37-6336-4f95-ba94-f3615dce12c3 => generated 109 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:53:57.423885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eaf4a305-6142-4a64-9737-9305343fe47c tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Calling method '.version_select at 0x7f204d5044c0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:57.470912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-eaf4a305-6142-4a64-9737-9305343fe47c tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] HTTP exception thrown: Volume 6d1ac9f3-43f5-4a14-ab62-d2139eef2798 could not be found. Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eaf4a305-6142-4a64-9737-9305343fe47c tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Request method failure captured: Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/os-volumes/6d1ac9f3-43f5-4a14-ab62-d2139eef2798 HTTP/1.1 Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoBy1geTcxo-AUghWoarQez0S9VL-QV8RECadFr6CXC1GdssELtDg0c509pY1LyUeAvTe98-Qvv-0d138sCfZ9cZUOSTiUR9ZmeDqkYXN6kHrDdQUK3BvJ3sQ_YR8nAfvCrfeYlCXC8mNWbvEfnJTFSpElAex2cvW9cn9OFf-iSOx0k Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:53:57.473298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3b48b3027ae4e4e9428bc00d9617f8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: a3b48b3027ae4e4e9428bc00d9617f8f Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-782050229 Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 80c7837783194f5b8db43da205c80f2c Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-782050229-project Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Volume 6d1ac9f3-43f5-4a14-ab62-d2139eef2798 could not be found. Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '6d1ac9f3-43f5-4a14-ab62-d2139eef2798'} Jul 04 05:53:57.474589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d1ac9f3-43f5-4a14-ab62-d2139eef2798 could not be found. (HTTP 404) (Request-ID: req-782d3021-ce5e-4cad-b56f-656c7ecfe2e9) Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:57.475454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 05:53:57.476576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d1ac9f3-43f5-4a14-ab62-d2139eef2798 could not be found. Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 05:53:57.477695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d1ac9f3-43f5-4a14-ab62-d2139eef2798 could not be found. Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d1ac9f3-43f5-4a14-ab62-d2139eef2798 could not be found. Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eaf4a305-6142-4a64-9737-9305343fe47c tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] Returning 404 to user: Volume 6d1ac9f3-43f5-4a14-ab62-d2139eef2798 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:53:57.478788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eaf4a305-6142-4a64-9737-9305343fe47c tempest-VolumesNegativeTest-782050229 tempest-VolumesNegativeTest-782050229-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6d1ac9f3-43f5-4a14-ab62-d2139eef2798" status: 404 len: 109 microversion: 2.1 time: 0.061920 Jul 04 05:53:57.486260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 9/10] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:53:57 2022] GET /compute/v2.1/os-volumes/6d1ac9f3-43f5-4a14-ab62-d2139eef2798 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:53:58.079465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-faa1f1e2-9014-4c24-8365-0bc36fa70a2e tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d49fe50>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:58.196988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f3cd7302-1c93-400b-853d-0f911e370d41 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.398087 Jul 04 05:53:58.197587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 2/11] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Jul 4 05:53:55 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2399 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 04 05:53:58.210386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fd986f34-2777-42a7-be07-a003ed3317ff tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] Calling method '.version_select at 0x7f204d4bca60>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:58.239156 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-faa1f1e2-9014-4c24-8365-0bc36fa70a2e tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764" status: 200 len: 345 microversion: 2.1 time: 0.156807 Jul 04 05:53:58.239156 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 10/12] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:53:58 2022] GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764 => generated 345 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:53:58.250854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-29ff0526-f6f2-4916-a95b-b57aba768d60 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Action: 'create', calling method: .version_select at 0x7f204d49fb80>, body: {"snapshot": {"volume_id": "e966ae44-f56f-4906-940c-4e0742800764", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1276414374"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:53:58.313398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fd986f34-2777-42a7-be07-a003ed3317ff tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed" status: 200 len: 352 microversion: 2.1 time: 0.107575 Jul 04 05:53:58.314689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 3/13] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:53:58 2022] GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:53:58.673492 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-29ff0526-f6f2-4916-a95b-b57aba768d60 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.432441 Jul 04 05:53:58.674344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 11/14] 10.222.0.42 () {60 vars in 1161 bytes} [Mon Jul 4 05:53:58 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:53:58.684906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b8177801-d5a5-411f-b3c0-9b0dbd0ca50a tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d4ca160>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:58.762322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b8177801-d5a5-411f-b3c0-9b0dbd0ca50a tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148" status: 200 len: 287 microversion: 2.1 time: 0.081505 Jul 04 05:53:58.762882 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 4/15] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jul 4 05:53:58 2022] GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:53:58.774560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-97f293ea-4202-4563-9852-5a3099b59eea tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d4b5af0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:58.854616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-97f293ea-4202-4563-9852-5a3099b59eea tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.084870 Jul 04 05:53:58.855700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 12/16] 10.222.0.42 () {58 vars in 1139 bytes} [Mon Jul 4 05:53:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:53:58.865475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d4ddb280-b91d-402e-8a68-dbbc6be4ceb8 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d4ca8b0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:58.919072 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d4ddb280-b91d-402e-8a68-dbbc6be4ceb8 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148" status: 200 len: 287 microversion: 2.1 time: 0.056760 Jul 04 05:53:58.920080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 5/17] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jul 4 05:53:58 2022] GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:53:59.327955 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6188e83b-e039-4f2e-a98a-fee4c605d1d9 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] Calling method '.version_select at 0x7f204d4a9d30>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:59.457058 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6188e83b-e039-4f2e-a98a-fee4c605d1d9 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed" status: 200 len: 353 microversion: 2.1 time: 0.134643 Jul 04 05:53:59.458436 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 13/18] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:53:59 2022] GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:53:59.470020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b3f960c-05cd-48b0-aba6-fc61762e6ada tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] Calling method '.version_select at 0x7f204d4bcd30>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:59.617801 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b3f960c-05cd-48b0-aba6-fc61762e6ada tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed" status: 200 len: 353 microversion: 2.1 time: 0.151631 Jul 04 05:53:59.618388 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 6/19] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:53:59 2022] GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:53:59.634754 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d28a0fe0-eab7-4631-833c-cf3c70cc50fe tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] Calling method '.version_select at 0x7f204d4a9280>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:59.799390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d28a0fe0-eab7-4631-833c-cf3c70cc50fe tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed" status: 202 len: 0 microversion: 2.1 time: 0.172225 Jul 04 05:53:59.800363 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 14/20] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jul 4 05:53:59 2022] DELETE /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:53:59.810512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c35f9a7a-5afa-40f7-b702-50f621f6a11e tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] Calling method '.version_select at 0x7f204d4ca9d0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:59.896287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c35f9a7a-5afa-40f7-b702-50f621f6a11e tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed" status: 200 len: 352 microversion: 2.1 time: 0.090813 Jul 04 05:53:59.896944 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 7/21] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:53:59 2022] GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:53:59.931611 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2b90852e-6bd9-4395-9c0a-7b4273f678af tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d4b5af0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:53:59.990398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2b90852e-6bd9-4395-9c0a-7b4273f678af tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148" status: 200 len: 287 microversion: 2.1 time: 0.063929 Jul 04 05:53:59.990991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 15/22] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jul 4 05:53:59 2022] GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:00.908968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0242bf8b-ef7e-4140-af7e-5f5c4f296148 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] Calling method '.version_select at 0x7f204d4ca3a0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:00.998567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0242bf8b-ef7e-4140-af7e-5f5c4f296148 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed" status: 200 len: 352 microversion: 2.1 time: 0.093398 Jul 04 05:54:00.999749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 8/23] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:54:00 2022] GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:01.002736 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3df5d63-09d7-4a40-983a-aed1587aa182 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d5044c0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:01.330558 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e3df5d63-09d7-4a40-983a-aed1587aa182 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148" status: 200 len: 287 microversion: 2.1 time: 0.332354 Jul 04 05:54:01.331762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 16/24] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jul 4 05:54:00 2022] GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 => generated 287 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:54:02.011550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a6be879e-5e9b-4a60-b7e4-388e1eba4fb2 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] Calling method '.version_select at 0x7f204d4bcdc0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:02.191321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a6be879e-5e9b-4a60-b7e4-388e1eba4fb2 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed" status: 200 len: 352 microversion: 2.1 time: 0.184019 Jul 04 05:54:02.192937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 9/25] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:54:02 2022] GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed => generated 352 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:02.342502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a311f8c0-cfab-4f6e-af60-c3cc0fa23908 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d49f820>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:02.418127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a311f8c0-cfab-4f6e-af60-c3cc0fa23908 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148" status: 200 len: 288 microversion: 2.1 time: 0.079587 Jul 04 05:54:02.419390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 17/26] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jul 4 05:54:02 2022] GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 => generated 288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:02.432925 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c779b23a-2191-45e2-b835-44083a763970 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d4ca040>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:02.593782 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c779b23a-2191-45e2-b835-44083a763970 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148" status: 202 len: 0 microversion: 2.1 time: 0.167860 Jul 04 05:54:02.594642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 10/27] 10.222.0.42 () {58 vars in 1253 bytes} [Mon Jul 4 05:54:02 2022] DELETE /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:54:02.609231 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dccc4483-08c6-49dd-895a-e78434d18352 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d4b5af0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:02.734043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dccc4483-08c6-49dd-895a-e78434d18352 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148" status: 200 len: 287 microversion: 2.1 time: 0.134783 Jul 04 05:54:02.734773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 18/28] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jul 4 05:54:02 2022] GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 => generated 287 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:03.215205 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2956090-ed27-4ad8-b712-c6c56e53b158 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] Calling method '.version_select at 0x7f204d4caa60>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:03.336504 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-f2956090-ed27-4ad8-b712-c6c56e53b158 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] HTTP exception thrown: Volume f5e14287-063f-40b0-a7ad-91c87158c1ed could not be found. Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2956090-ed27-4ad8-b712-c6c56e53b158 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] Request method failure captured: Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed HTTP/1.1 Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoByj6SNMrXWkapeGZUmO0J-B7cQ_qy_yZh7AC6tPeah7eeVY0HsivNyknd4tAbAmuwdJB9pcuuJRdwfjciA0vZnNzr1IVyJvUZ1Au33ueAsMchUkevUe8HHGsTRdthIdie8ZTLu5u425ece0SFpXZ-RVc5lOISUsqdWC9OezzDdBhU Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: b63ffe62990842e4b20b86218bf26dc3 Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesGetTestJSON-360946212 Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 05:54:03.341060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b63ffe62990842e4b20b86218bf26dc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b63ffe62990842e4b20b86218bf26dc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b63ffe62990842e4b20b86218bf26dc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b63ffe62990842e4b20b86218bf26dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesGetTestJSON-360946212 Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: b63ffe62990842e4b20b86218bf26dc3 Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesGetTestJSON-360946212 Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesGetTestJSON-360946212-project Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: c6febb3bb852434fb29d0ef3c59cfa7c Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesGetTestJSON-360946212-project Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Volume f5e14287-063f-40b0-a7ad-91c87158c1ed could not be found. Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': 'f5e14287-063f-40b0-a7ad-91c87158c1ed'} Jul 04 05:54:03.342494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5e14287-063f-40b0-a7ad-91c87158c1ed could not be found. (HTTP 404) (Request-ID: req-a90b1670-c79b-498f-ac82-e00d149eea41) Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:03.343378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 05:54:03.344558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5e14287-063f-40b0-a7ad-91c87158c1ed could not be found. Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 05:54:03.345680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:54:03.346784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5e14287-063f-40b0-a7ad-91c87158c1ed could not be found. Jul 04 05:54:03.346784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.346784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:03.346784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.346784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:03.346784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:54:03.346784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:54:03.346784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:54:03.346784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:54:03.346784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5e14287-063f-40b0-a7ad-91c87158c1ed could not be found. Jul 04 05:54:03.346784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.348340 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2956090-ed27-4ad8-b712-c6c56e53b158 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] Returning 404 to user: Volume f5e14287-063f-40b0-a7ad-91c87158c1ed could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:54:03.349336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f2956090-ed27-4ad8-b712-c6c56e53b158 tempest-VolumesGetTestJSON-360946212 tempest-VolumesGetTestJSON-360946212-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed" status: 404 len: 109 microversion: 2.1 time: 0.143537 Jul 04 05:54:03.350509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 11/29] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:54:03 2022] GET /compute/v2.1/os-volumes/f5e14287-063f-40b0-a7ad-91c87158c1ed => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:54:03.748541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ecca3602-7b45-420f-a770-b43180771d0c tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d4a93a0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:03.795376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-ecca3602-7b45-420f-a770-b43180771d0c tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] HTTP exception thrown: Snapshot cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 could not be found. Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ecca3602-7b45-420f-a770-b43180771d0c tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Request method failure captured: Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 HTTP/1.1 Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoBxtPj7zKoktpByElWjiOL71l6TpvBkHxcWO5x2R9WyBL8RV23-O0mGgNL_er_dY20juj1DjF5EpZyKpDNEMz9mQe5TNswCT4wPz57n6qTNMPScnNL1eYtlBso4WQwhFEOkkseB0kIvYTXIE-FiCkQsjnR90b5yqzpCRNhnQdjz-74 Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: cbb322e1350d44e496c53ffc9b869d7a Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:54:03.798516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: cbb322e1350d44e496c53ffc9b869d7a Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotsTestJSON-1431488452-project Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 72cb1ae8aa5243fca51dcff137181004 Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1431488452-project Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Snapshot cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 could not be found. Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': 'cbf4e4cc-fd78-4d00-96a5-7bbb8b038148'} Jul 04 05:54:03.799750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 could not be found. (HTTP 404) (Request-ID: req-cc60677c-aa82-442d-9655-e27ecdd74815) Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.800445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 05:54:03.801657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 could not be found. Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 04 05:54:03.802518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 could not be found. Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 could not be found. Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ecca3602-7b45-420f-a770-b43180771d0c tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Returning 404 to user: Snapshot cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:54:03.803496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ecca3602-7b45-420f-a770-b43180771d0c tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148" status: 404 len: 111 microversion: 2.1 time: 0.056352 Jul 04 05:54:03.805695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 19/30] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jul 4 05:54:03 2022] GET /compute/v2.1/os-snapshots/cbf4e4cc-fd78-4d00-96a5-7bbb8b038148 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:54:03.812689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e14bbce-d2ba-46be-a31e-30ac49f0bfa7 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d49e160>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:04.014457 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e14bbce-d2ba-46be-a31e-30ac49f0bfa7 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764" status: 202 len: 0 microversion: 2.1 time: 0.207739 Jul 04 05:54:04.015070 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 12/31] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jul 4 05:54:03 2022] DELETE /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:54:04.025285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-383e5d4d-8a07-482f-93cd-ebb2a171ccbc tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d4a93a0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:04.132499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-383e5d4d-8a07-482f-93cd-ebb2a171ccbc tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764" status: 200 len: 344 microversion: 2.1 time: 0.112501 Jul 04 05:54:04.137601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 20/32] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:54:04 2022] GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764 => generated 344 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:05.148458 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a63b1f01-696d-4ff8-91f6-3a750923e301 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d4b5820>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:05.198204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-a63b1f01-696d-4ff8-91f6-3a750923e301 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] HTTP exception thrown: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a63b1f01-696d-4ff8-91f6-3a750923e301 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Request method failure captured: Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764 HTTP/1.1 Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoBxtPj7zKoktpByElWjiOL71l6TpvBkHxcWO5x2R9WyBL8RV23-O0mGgNL_er_dY20juj1DjF5EpZyKpDNEMz9mQe5TNswCT4wPz57n6qTNMPScnNL1eYtlBso4WQwhFEOkkseB0kIvYTXIE-FiCkQsjnR90b5yqzpCRNhnQdjz-74 Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: cbb322e1350d44e496c53ffc9b869d7a Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:54:05.211449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: cbb322e1350d44e496c53ffc9b869d7a Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotsTestJSON-1431488452-project Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 72cb1ae8aa5243fca51dcff137181004 Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1431488452-project Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': 'e966ae44-f56f-4906-940c-4e0742800764'} Jul 04 05:54:05.212788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. (HTTP 404) (Request-ID: req-d1e1870c-116d-4d1f-af51-9b79e8ba799b) Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:05.213526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 05:54:05.214608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 05:54:05.215719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a63b1f01-696d-4ff8-91f6-3a750923e301 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Returning 404 to user: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:54:05.219099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a63b1f01-696d-4ff8-91f6-3a750923e301 tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764" status: 404 len: 109 microversion: 2.1 time: 0.070270 Jul 04 05:54:05.224948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 21/33] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:54:05 2022] GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:54:05.235557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0ee6ac25-6cba-4d87-9c49-e0222a8734ea tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d49f160>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:05.283094 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-0ee6ac25-6cba-4d87-9c49-e0222a8734ea tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] HTTP exception thrown: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0ee6ac25-6cba-4d87-9c49-e0222a8734ea tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Request method failure captured: Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764 HTTP/1.1 Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoBxtPj7zKoktpByElWjiOL71l6TpvBkHxcWO5x2R9WyBL8RV23-O0mGgNL_er_dY20juj1DjF5EpZyKpDNEMz9mQe5TNswCT4wPz57n6qTNMPScnNL1eYtlBso4WQwhFEOkkseB0kIvYTXIE-FiCkQsjnR90b5yqzpCRNhnQdjz-74 Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: cbb322e1350d44e496c53ffc9b869d7a Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:54:05.285516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: cbb322e1350d44e496c53ffc9b869d7a Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotsTestJSON-1431488452-project Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 72cb1ae8aa5243fca51dcff137181004 Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1431488452-project Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': 'e966ae44-f56f-4906-940c-4e0742800764'} Jul 04 05:54:05.286634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. (HTTP 404) (Request-ID: req-5e517d2d-f308-4cb1-9031-ad11a6fcb70c) Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:05.287291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 05:54:05.288394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 05:54:05.289376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:54:05.290328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.290328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.290328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:05.290328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.290328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.290328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:54:05.290328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:54:05.290328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:54:05.290328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:54:05.290328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.290328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.291662 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0ee6ac25-6cba-4d87-9c49-e0222a8734ea tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Returning 404 to user: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:54:05.293002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0ee6ac25-6cba-4d87-9c49-e0222a8734ea tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764" status: 404 len: 109 microversion: 2.1 time: 0.066351 Jul 04 05:54:05.293877 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 22/34] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jul 4 05:54:05 2022] DELETE /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:54:05.315902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b115d5f7-5f04-4a8d-97d3-1bd12d4e67cb tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Calling method '.version_select at 0x7f204d4a9a60>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:05.363479 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-b115d5f7-5f04-4a8d-97d3-1bd12d4e67cb tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] HTTP exception thrown: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b115d5f7-5f04-4a8d-97d3-1bd12d4e67cb tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Request method failure captured: Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764 HTTP/1.1 Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoBxtPj7zKoktpByElWjiOL71l6TpvBkHxcWO5x2R9WyBL8RV23-O0mGgNL_er_dY20juj1DjF5EpZyKpDNEMz9mQe5TNswCT4wPz57n6qTNMPScnNL1eYtlBso4WQwhFEOkkseB0kIvYTXIE-FiCkQsjnR90b5yqzpCRNhnQdjz-74 Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: cbb322e1350d44e496c53ffc9b869d7a Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:54:05.365620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cbb322e1350d44e496c53ffc9b869d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: cbb322e1350d44e496c53ffc9b869d7a Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1431488452 Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotsTestJSON-1431488452-project Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 72cb1ae8aa5243fca51dcff137181004 Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1431488452-project Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': 'e966ae44-f56f-4906-940c-4e0742800764'} Jul 04 05:54:05.366672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. (HTTP 404) (Request-ID: req-37e03c95-a300-4e8e-a653-3a18cbbd532e) Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:05.367397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 05:54:05.368280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 05:54:05.369226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b115d5f7-5f04-4a8d-97d3-1bd12d4e67cb tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] Returning 404 to user: Volume e966ae44-f56f-4906-940c-4e0742800764 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:54:05.370084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b115d5f7-5f04-4a8d-97d3-1bd12d4e67cb tempest-VolumesSnapshotsTestJSON-1431488452 tempest-VolumesSnapshotsTestJSON-1431488452-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764" status: 404 len: 109 microversion: 2.1 time: 0.065626 Jul 04 05:54:05.370798 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 23/35] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:54:05 2022] GET /compute/v2.1/os-volumes/e966ae44-f56f-4906-940c-4e0742800764 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:54:05.462472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6432f833-e6c4-41b8-86e0-90259692b90d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Action: 'create', calling method: .version_select at 0x7f204d49e820>, body: {"keypair": {"name": "tempest-keypair-220569195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+XaEwIb7ziIGvN+yjszJlssghdNeKgNrCNWC6IT5kUQI9CevvULmw+56uLuGFC9Pk2SVU4Wj54PdOeakJfGe53YOiShIo5/eVK4a3oUEXNHXiYN09EUAwG1NwCEj8hSw=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:05.594781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6432f833-e6c4-41b8-86e0-90259692b90d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Getting quotas for project f3251b70a6c64287acc95cc99d4e3b4d. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:54:05.618942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6432f833-e6c4-41b8-86e0-90259692b90d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Getting quotas for user 982651a870c44a07bc4df322919e605e and project f3251b70a6c64287acc95cc99d4e3b4d. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:54:05.746703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6432f833-e6c4-41b8-86e0-90259692b90d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.630981 Jul 04 05:54:05.748047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 13/36] 10.222.0.42 () {62 vars in 1199 bytes} [Mon Jul 4 05:54:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 633 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 04 05:54:07.691696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1887747582", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "networks": [{"uuid": "341736d2-ff12-4086-9b28-2109d978f92a"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:07.914995 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] validate_networks() for [('341736d2-ff12-4086-9b28-2109d978f92a', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:54:09.806309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b1b4d2d-257d-4c4f-a843-d213261ebff1 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] Calling method '.version_select at 0x7f204d4095e0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:09.886721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4b1b4d2d-257d-4c4f-a843-d213261ebff1 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/8a644a04-44f6-4b9f-b999-70aa3fba2538" status: 200 len: 350 microversion: 2.1 time: 0.101411 Jul 04 05:54:09.897384 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 14/37] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:54:09 2022] GET /compute/v2.1/os-volumes/8a644a04-44f6-4b9f-b999-70aa3fba2538 => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:11.276912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:54:11.277818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:54:11.278294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:54:11.278708 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:54:11.279369 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:54:11.341346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:11.341815 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:11.342693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:11.367603 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:11.511595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Getting quotas for project 413717d499504cb29cb26d08bedf7e0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:54:11.556213 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Getting quotas for user 3e05d19530a74e05a11be774102b425a and project 413717d499504cb29cb26d08bedf7e0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:54:11.580607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:54:11.593891 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:54:11.743287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ae77006c-43ba-4a4e-8cf7-01e30b8caf03 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] Calling method '.version_select at 0x7f204d409ca0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:11.788260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-34e82aaa-ee3c-4a35-bd3b-56bb05c8aeb7 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.342835 Jul 04 05:54:11.788940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 24/38] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 4355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:54:11.800273 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0d5fb25a-7706-4941-b6e9-b36b28cba893 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:11.810763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0d5fb25a-7706-4941-b6e9-b36b28cba893 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:11.940015 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ae77006c-43ba-4a4e-8cf7-01e30b8caf03 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d949a0ea-ba99-4b86-bc88-506164d60d3b" status: 200 len: 351 microversion: 2.1 time: 0.204147 Jul 04 05:54:11.940631 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 15/39] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:54:11 2022] GET /compute/v2.1/os-volumes/d949a0ea-ba99-4b86-bc88-506164d60d3b => generated 351 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:54:12.218815 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0d5fb25a-7706-4941-b6e9-b36b28cba893 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:12.255947 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0d5fb25a-7706-4941-b6e9-b36b28cba893 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1215 microversion: 2.1 time: 0.460076 Jul 04 05:54:12.257853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 25/40] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:11 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1215 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:13.274661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-68348889-4ae3-42fc-ac2d-1087044e0330 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:13.275520 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-68348889-4ae3-42fc-ac2d-1087044e0330 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:13.437291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68348889-4ae3-42fc-ac2d-1087044e0330 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:13.444374 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-68348889-4ae3-42fc-ac2d-1087044e0330 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1215 microversion: 2.1 time: 0.174370 Jul 04 05:54:13.444960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 26/41] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:13 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:13.571017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ca31df9-40f0-4fcb-bcd8-8ed017a3c3b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Action: 'create', calling method: .version_select at 0x7f204cbb03a0>, body: {"keypair": {"name": "tempest-keypair-108030197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFD9ItzjsgSj4/BEyTtNNnDscwdUaVYMjNucifeIku7mIMIRM4MYxptkz1whohPMrFdOeKwVo4yc8wu9/LTTpkGcCEWCwmr+lTBz7CazJLb1xT0huUfD7wRqSmpq8Xi03w=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:13.633533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-1ca31df9-40f0-4fcb-bcd8-8ed017a3c3b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Getting quotas for project bdd96113d4ef451d9ffc81c03c6ea70e. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:54:13.652806 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-1ca31df9-40f0-4fcb-bcd8-8ed017a3c3b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Getting quotas for user 32703b5451cf48b09966a7412b747099 and project bdd96113d4ef451d9ffc81c03c6ea70e. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:54:13.730817 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ca31df9-40f0-4fcb-bcd8-8ed017a3c3b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.897130 Jul 04 05:54:13.732271 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 16/42] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jul 4 05:54:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:13.778546 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-596108215", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52917e3a-98b6-48ca-9924-af082e54387c"}], "security_groups": [{"name": "tempest-securitygroup--1026034130"}], "key_name": "tempest-keypair-220569195", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:14.063111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-97600aee-7672-40bf-ad7b-72eb9c4165ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Action: 'create', calling method: .version_select at 0x7f204cb5fa60>, body: {"keypair": {"name": "tempest-keypair-842269947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHY1Td1t/oY3NcS7iq25lZYiSfE+Svw7E5vCL7z50TxnjlDAGlWgFYZEv3pE0naqUMDEels87I9STIHJ0h+3u1Lf+Vd94njaDZCdrp89pRXgRFx9ou8YghPC6sWAdV0lyg=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:14.121328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-97600aee-7672-40bf-ad7b-72eb9c4165ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for project 4e16375231df4b768b8355e320e91731. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:54:14.132663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-97600aee-7672-40bf-ad7b-72eb9c4165ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for user e367c76dfa7f4d2791e60ce148f352c3 and project 4e16375231df4b768b8355e320e91731. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:54:14.214696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-97600aee-7672-40bf-ad7b-72eb9c4165ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.702661 Jul 04 05:54:14.217096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 27/43] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jul 4 05:54:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:54:14.222252 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bd9ff92e-6e1a-4060-bd23-b14511f01e3b tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] Calling method '.version_select at 0x7f204c2ea3a0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:14.447216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] validate_networks() for [('52917e3a-98b6-48ca-9924-af082e54387c', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:54:14.621350 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bd9ff92e-6e1a-4060-bd23-b14511f01e3b tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/125d8861-0707-44f7-8766-adb827fe480b" status: 200 len: 350 microversion: 2.1 time: 0.402649 Jul 04 05:54:14.622029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 28/44] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jul 4 05:54:14 2022] GET /compute/v2.1/os-volumes/125d8861-0707-44f7-8766-adb827fe480b => generated 350 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:14.626891 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fd7cb643-1c30-4a5f-bb23-cd0678f69f00 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:14.627677 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fd7cb643-1c30-4a5f-bb23-cd0678f69f00 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:15.592110 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fd7cb643-1c30-4a5f-bb23-cd0678f69f00 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:15.616656 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fd7cb643-1c30-4a5f-bb23-cd0678f69f00 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1215 microversion: 2.1 time: 0.985661 Jul 04 05:54:15.625598 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 29/45] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:14 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1215 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:15.640208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e8e28bc5-712c-4fe2-9680-a003ff5843dd tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] Calling method '.version_select at 0x7f204c2ead30>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:15.926087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e8e28bc5-712c-4fe2-9680-a003ff5843dd tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.297503 Jul 04 05:54:15.932799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 30/46] 10.222.0.42 () {58 vars in 1133 bytes} [Mon Jul 4 05:54:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:15.945291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5933a4f-7d85-42e3-95e2-d71a31122501 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] Calling method '.version_select at 0x7f204cb38f70>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:16.238501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5933a4f-7d85-42e3-95e2-d71a31122501 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.296702 Jul 04 05:54:16.239882 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 31/47] 10.222.0.42 () {58 vars in 1148 bytes} [Mon Jul 4 05:54:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:16.258776 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3313a88f-b47a-46cc-a0ed-8aa2e159a828 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] Calling method '.version_select at 0x7f204c30c430>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:16.526767 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:54:16.527361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:54:16.528133 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:54:16.528647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:54:16.529228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:54:16.536449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3313a88f-b47a-46cc-a0ed-8aa2e159a828 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.282941 Jul 04 05:54:16.537282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 32/48] 10.222.0.42 () {58 vars in 1133 bytes} [Mon Jul 4 05:54:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:16.548238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-14bfd690-5943-4b50-b492-c85219da0fe3 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] Calling method '.version_select at 0x7f204c30c310>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:16.553224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:16.557332 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:16.561830 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:16.562398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:16.664197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Getting quotas for project f3251b70a6c64287acc95cc99d4e3b4d. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:54:16.683163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Getting quotas for user 982651a870c44a07bc4df322919e605e and project f3251b70a6c64287acc95cc99d4e3b4d. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:54:16.707056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:54:16.717899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:54:16.953346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1d754f85-e26b-419b-9226-26cb1b4a9376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.180376 Jul 04 05:54:16.957810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 17/49] 10.222.0.42 () {62 vars in 1187 bytes} [Mon Jul 4 05:54:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 3185 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 04 05:54:16.978423 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-85565361-43f9-4f4d-b510-7295a7ca8c7a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:16.979792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-85565361-43f9-4f4d-b510-7295a7ca8c7a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:16.987856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-14bfd690-5943-4b50-b492-c85219da0fe3 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.443420 Jul 04 05:54:16.988835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 33/50] 10.222.0.42 () {58 vars in 1166 bytes} [Mon Jul 4 05:54:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:54:16.999482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b7c4f66-eafa-4f95-a13b-127a19326f8f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:17.000073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6b7c4f66-eafa-4f95-a13b-127a19326f8f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:17.025909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85565361-43f9-4f4d-b510-7295a7ca8c7a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:17.028356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85565361-43f9-4f4d-b510-7295a7ca8c7a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:17.029513 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85565361-43f9-4f4d-b510-7295a7ca8c7a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:17.030192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85565361-43f9-4f4d-b510-7295a7ca8c7a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:17.519439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-85565361-43f9-4f4d-b510-7295a7ca8c7a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:17.568138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-85565361-43f9-4f4d-b510-7295a7ca8c7a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1273 microversion: 2.1 time: 0.602503 Jul 04 05:54:17.568138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 18/51] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:16 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1273 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:17.569680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d412b434-a609-4bb8-a21e-48fffb55fc07 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] Calling method '.version_select at 0x7f204c293790>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:17.807233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6b7c4f66-eafa-4f95-a13b-127a19326f8f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:17.816415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6b7c4f66-eafa-4f95-a13b-127a19326f8f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:17.817933 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6b7c4f66-eafa-4f95-a13b-127a19326f8f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:17.849751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6b7c4f66-eafa-4f95-a13b-127a19326f8f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1280 microversion: 2.20 time: 0.859043 Jul 04 05:54:17.858923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 34/52] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:16 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1280 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:17.885881 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d412b434-a609-4bb8-a21e-48fffb55fc07 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.320829 Jul 04 05:54:17.886850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 19/53] 10.222.0.42 () {58 vars in 1169 bytes} [Mon Jul 4 05:54:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:17.899518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-050d7c5a-0317-4b85-8982-41d3dcd0dfbd tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] Calling method '.version_select at 0x7f204c2ea0d0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:18.228846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-050d7c5a-0317-4b85-8982-41d3dcd0dfbd tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.333180 Jul 04 05:54:18.231107 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 35/54] 10.222.0.42 () {58 vars in 1154 bytes} [Mon Jul 4 05:54:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:18.244208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9168f30f-cc8c-4c9d-8b49-5c979f05a308 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] Calling method '.version_select at 0x7f204d4ca1f0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:18.542440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9168f30f-cc8c-4c9d-8b49-5c979f05a308 tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.303988 Jul 04 05:54:18.549648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 20/55] 10.222.0.42 () {58 vars in 1187 bytes} [Mon Jul 4 05:54:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:18.558128 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e803538e-0556-46fe-b1dd-36a1e5aa250b tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] Calling method '.version_select at 0x7f204c30c670>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:18.583934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a6229573-c823-4ae5-8e67-de38d6e723d0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:18.585267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a6229573-c823-4ae5-8e67-de38d6e723d0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:18.597365 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6229573-c823-4ae5-8e67-de38d6e723d0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:18.606094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6229573-c823-4ae5-8e67-de38d6e723d0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:18.607163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6229573-c823-4ae5-8e67-de38d6e723d0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:18.608173 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6229573-c823-4ae5-8e67-de38d6e723d0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:18.854210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e803538e-0556-46fe-b1dd-36a1e5aa250b tempest-VolumesTestJSON-1485681390 tempest-VolumesTestJSON-1485681390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.301557 Jul 04 05:54:18.855344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 36/56] 10.222.0.42 () {58 vars in 1154 bytes} [Mon Jul 4 05:54:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:18.875157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f008163e-1138-4061-9e56-44946e2d219f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:18.878582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f008163e-1138-4061-9e56-44946e2d219f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:18.923382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f008163e-1138-4061-9e56-44946e2d219f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:18.926228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f008163e-1138-4061-9e56-44946e2d219f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:18.943534 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f008163e-1138-4061-9e56-44946e2d219f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:18.949213 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f008163e-1138-4061-9e56-44946e2d219f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:19.447382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6229573-c823-4ae5-8e67-de38d6e723d0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:19.489411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a6229573-c823-4ae5-8e67-de38d6e723d0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1273 microversion: 2.1 time: 0.895655 Jul 04 05:54:19.490129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 21/57] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:18 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1273 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:19.551331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f008163e-1138-4061-9e56-44946e2d219f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:19.584177 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f008163e-1138-4061-9e56-44946e2d219f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:19.586583 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f008163e-1138-4061-9e56-44946e2d219f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:19.591538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f008163e-1138-4061-9e56-44946e2d219f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1332 microversion: 2.20 time: 0.720443 Jul 04 05:54:19.594136 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 37/58] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:18 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1332 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:20.516927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-79a9d761-ec21-4b4b-9a15-87237830c05c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:20.517838 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-79a9d761-ec21-4b4b-9a15-87237830c05c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:20.528082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79a9d761-ec21-4b4b-9a15-87237830c05c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:20.528677 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79a9d761-ec21-4b4b-9a15-87237830c05c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:20.529902 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79a9d761-ec21-4b4b-9a15-87237830c05c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:20.530516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79a9d761-ec21-4b4b-9a15-87237830c05c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:20.611430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7b502990-ecb3-4868-a7e9-c6b3528511b3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:20.612680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7b502990-ecb3-4868-a7e9-c6b3528511b3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:20.620365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b502990-ecb3-4868-a7e9-c6b3528511b3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:20.622598 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b502990-ecb3-4868-a7e9-c6b3528511b3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:20.623774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b502990-ecb3-4868-a7e9-c6b3528511b3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:20.624517 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b502990-ecb3-4868-a7e9-c6b3528511b3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:20.749529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b502990-ecb3-4868-a7e9-c6b3528511b3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:20.787410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b502990-ecb3-4868-a7e9-c6b3528511b3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:20.789474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b502990-ecb3-4868-a7e9-c6b3528511b3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:20.804267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7b502990-ecb3-4868-a7e9-c6b3528511b3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1340 microversion: 2.20 time: 0.183453 Jul 04 05:54:20.812450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 38/59] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:20 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1340 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:21.068222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-79a9d761-ec21-4b4b-9a15-87237830c05c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:21.077529 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-79a9d761-ec21-4b4b-9a15-87237830c05c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.570708 Jul 04 05:54:21.089287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 22/60] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:20 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:21.307532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-3499868", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f5266ef-05a5-42cb-ab01-a1f99eea484b"}], "security_groups": [{"name": "tempest-securitygroup--1030705660"}], "key_name": "tempest-keypair-108030197", "user_data": "}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:21.459822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:21.514512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] validate_networks() for [('8f5266ef-05a5-42cb-ab01-a1f99eea484b', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:54:21.814373 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-80cdd5ca-43b3-4dac-a6b4-421f573d3d6d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:21.815176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-80cdd5ca-43b3-4dac-a6b4-421f573d3d6d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:21.827525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80cdd5ca-43b3-4dac-a6b4-421f573d3d6d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:21.828238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80cdd5ca-43b3-4dac-a6b4-421f573d3d6d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:21.829345 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80cdd5ca-43b3-4dac-a6b4-421f573d3d6d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:21.831167 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80cdd5ca-43b3-4dac-a6b4-421f573d3d6d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:22.063444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-80cdd5ca-43b3-4dac-a6b4-421f573d3d6d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:22.080442 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-80cdd5ca-43b3-4dac-a6b4-421f573d3d6d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:22.081839 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-80cdd5ca-43b3-4dac-a6b4-421f573d3d6d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:22.086023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-80cdd5ca-43b3-4dac-a6b4-421f573d3d6d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1350 microversion: 2.20 time: 0.276209 Jul 04 05:54:22.092308 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 23/61] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:21 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1350 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:22.105398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-03446f96-1748-4636-8ed2-6a820b6376ea tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:22.110807 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-03446f96-1748-4636-8ed2-6a820b6376ea tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:22.127698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03446f96-1748-4636-8ed2-6a820b6376ea tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:22.129083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03446f96-1748-4636-8ed2-6a820b6376ea tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:22.130079 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03446f96-1748-4636-8ed2-6a820b6376ea tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:22.132286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03446f96-1748-4636-8ed2-6a820b6376ea tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:22.382051 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:54:22.382665 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:54:22.382940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:54:22.383380 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:54:22.383791 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:54:22.397701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:22.397701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:22.398504 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:22.398973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:22.450816 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Getting quotas for project bdd96113d4ef451d9ffc81c03c6ea70e. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:54:22.456195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Getting quotas for user 32703b5451cf48b09966a7412b747099 and project bdd96113d4ef451d9ffc81c03c6ea70e. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:54:22.472264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:54:22.475852 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:54:22.542804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-03446f96-1748-4636-8ed2-6a820b6376ea tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:22.550351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-03446f96-1748-4636-8ed2-6a820b6376ea tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.456562 Jul 04 05:54:22.557826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 24/62] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:22 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:22.563119 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-228974854", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cff6865-4d61-43fd-b392-bb40cec9d37d"}], "security_groups": [{"name": "tempest-securitygroup--1338239798"}], "key_name": "tempest-keypair-842269947", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:22.591609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-43750ea9-50cf-481c-8cf9-1c4cd6028097 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.285267 Jul 04 05:54:22.593036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 39/63] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:54:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:54:22.606581 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0638ff3-f4bd-45ea-bd9d-2bfb9824928f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:22.626093 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0638ff3-f4bd-45ea-bd9d-2bfb9824928f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:22.779208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f0638ff3-f4bd-45ea-bd9d-2bfb9824928f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:22.793503 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0638ff3-f4bd-45ea-bd9d-2bfb9824928f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1234 microversion: 2.1 time: 0.193135 Jul 04 05:54:22.794655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 40/64] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:22 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1234 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:23.111159 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6a8cce6d-c99b-4405-8a72-661181fc0b0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:23.112021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6a8cce6d-c99b-4405-8a72-661181fc0b0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:23.126890 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a8cce6d-c99b-4405-8a72-661181fc0b0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:23.146360 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a8cce6d-c99b-4405-8a72-661181fc0b0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:23.153765 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a8cce6d-c99b-4405-8a72-661181fc0b0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:23.154295 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a8cce6d-c99b-4405-8a72-661181fc0b0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:23.352005 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6a8cce6d-c99b-4405-8a72-661181fc0b0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:23.369805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6a8cce6d-c99b-4405-8a72-661181fc0b0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:23.371479 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6a8cce6d-c99b-4405-8a72-661181fc0b0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:23.374165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6a8cce6d-c99b-4405-8a72-661181fc0b0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1338 microversion: 2.20 time: 0.267989 Jul 04 05:54:23.378618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 41/65] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:23 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1338 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:54:23.577610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb621364-355f-46e6-9f02-3f038b4cff96 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:23.577610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bb621364-355f-46e6-9f02-3f038b4cff96 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:23.588511 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb621364-355f-46e6-9f02-3f038b4cff96 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:23.589992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb621364-355f-46e6-9f02-3f038b4cff96 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:23.592885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb621364-355f-46e6-9f02-3f038b4cff96 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:23.594333 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb621364-355f-46e6-9f02-3f038b4cff96 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:23.867839 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] validate_networks() for [('9cff6865-4d61-43fd-b392-bb40cec9d37d', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:54:24.869431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bb621364-355f-46e6-9f02-3f038b4cff96 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:24.894725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bb621364-355f-46e6-9f02-3f038b4cff96 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 1.318291 Jul 04 05:54:24.900897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 42/66] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:23 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:24.933823 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-282ffa2c-ef44-4215-8a52-6653c983755d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:24.939139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-282ffa2c-ef44-4215-8a52-6653c983755d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:24.980483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-282ffa2c-ef44-4215-8a52-6653c983755d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:24.980595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-282ffa2c-ef44-4215-8a52-6653c983755d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:24.981340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-282ffa2c-ef44-4215-8a52-6653c983755d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:24.981774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-282ffa2c-ef44-4215-8a52-6653c983755d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:25.610011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-282ffa2c-ef44-4215-8a52-6653c983755d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:25.620904 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-282ffa2c-ef44-4215-8a52-6653c983755d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1286 microversion: 2.1 time: 0.716888 Jul 04 05:54:25.621514 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 43/67] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:24 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1286 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:25.651104 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2e2be19f-4d6c-43d4-9a3c-bec44bf1f177 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:25.653873 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2e2be19f-4d6c-43d4-9a3c-bec44bf1f177 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:25.676619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e2be19f-4d6c-43d4-9a3c-bec44bf1f177 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:25.680222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e2be19f-4d6c-43d4-9a3c-bec44bf1f177 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:25.683147 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e2be19f-4d6c-43d4-9a3c-bec44bf1f177 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:25.683841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e2be19f-4d6c-43d4-9a3c-bec44bf1f177 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:26.047561 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2e2be19f-4d6c-43d4-9a3c-bec44bf1f177 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:26.068550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2e2be19f-4d6c-43d4-9a3c-bec44bf1f177 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:26.080300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2e2be19f-4d6c-43d4-9a3c-bec44bf1f177 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:26.081721 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2e2be19f-4d6c-43d4-9a3c-bec44bf1f177 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1338 microversion: 2.20 time: 0.440870 Jul 04 05:54:26.084973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 44/68] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:25 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1338 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:26.103378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0348c9a8-f283-4db9-b25d-44b374194cd6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:26.106943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0348c9a8-f283-4db9-b25d-44b374194cd6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:26.125271 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0348c9a8-f283-4db9-b25d-44b374194cd6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:26.131629 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0348c9a8-f283-4db9-b25d-44b374194cd6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:26.132789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0348c9a8-f283-4db9-b25d-44b374194cd6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:26.137163 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0348c9a8-f283-4db9-b25d-44b374194cd6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:26.621082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:26.695850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=14 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:26.760424 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:54:26.760761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:54:26.761448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:54:26.762107 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:54:26.762661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:54:26.781895 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:26.782658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:26.786133 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:26.786589 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:26.815444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0348c9a8-f283-4db9-b25d-44b374194cd6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:26.824385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0348c9a8-f283-4db9-b25d-44b374194cd6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.734845 Jul 04 05:54:26.829499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 45/69] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:26 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:26.840363 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a516de8-3885-4433-a2b5-b9620971e0e2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:26.844080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a516de8-3885-4433-a2b5-b9620971e0e2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:26.856366 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a516de8-3885-4433-a2b5-b9620971e0e2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:26.859473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a516de8-3885-4433-a2b5-b9620971e0e2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:26.861573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a516de8-3885-4433-a2b5-b9620971e0e2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:26.862985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a516de8-3885-4433-a2b5-b9620971e0e2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:26.917548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for project 4e16375231df4b768b8355e320e91731. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:54:26.947121 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for user e367c76dfa7f4d2791e60ce148f352c3 and project 4e16375231df4b768b8355e320e91731. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:54:26.982402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:54:26.989648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:54:27.125172 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01aef67d-801f-4ce5-a610-8d90bb17c875 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.566111 Jul 04 05:54:27.126365 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 25/70] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:54:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 4568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:54:27.132848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7d37716b-825d-40e9-9579-06e91d2558ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:27.135815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7d37716b-825d-40e9-9579-06e91d2558ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:27.151099 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d37716b-825d-40e9-9579-06e91d2558ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:27.151761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d37716b-825d-40e9-9579-06e91d2558ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:27.153927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d37716b-825d-40e9-9579-06e91d2558ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:27.155006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d37716b-825d-40e9-9579-06e91d2558ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:27.324076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4a516de8-3885-4433-a2b5-b9620971e0e2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:27.351142 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a516de8-3885-4433-a2b5-b9620971e0e2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1292 microversion: 2.1 time: 0.514303 Jul 04 05:54:27.353564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 46/71] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:26 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1292 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:27.371488 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7441dd1c-2924-4b34-9252-ea316fa51898 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:27.390516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7441dd1c-2924-4b34-9252-ea316fa51898 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:27.714015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7441dd1c-2924-4b34-9252-ea316fa51898 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:27.727112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7441dd1c-2924-4b34-9252-ea316fa51898 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1240 microversion: 2.1 time: 0.372208 Jul 04 05:54:27.728027 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 47/72] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:27 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1240 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:27.775376 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d37716b-825d-40e9-9579-06e91d2558ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:27.796215 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d37716b-825d-40e9-9579-06e91d2558ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:27.797947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d37716b-825d-40e9-9579-06e91d2558ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:27.801548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7d37716b-825d-40e9-9579-06e91d2558ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.673930 Jul 04 05:54:27.803042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 26/73] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:27 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:27.846654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-966f778b-b883-4555-98b4-4851a9534d3a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:27.847543 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-966f778b-b883-4555-98b4-4851a9534d3a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:27.861705 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-966f778b-b883-4555-98b4-4851a9534d3a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:27.867878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-966f778b-b883-4555-98b4-4851a9534d3a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:27.872523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-966f778b-b883-4555-98b4-4851a9534d3a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:27.878044 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-966f778b-b883-4555-98b4-4851a9534d3a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:28.384248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-be6ef1d5-1330-4ea6-b2bc-3e2bcaec3b94 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:28.385050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-be6ef1d5-1330-4ea6-b2bc-3e2bcaec3b94 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:28.429275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be6ef1d5-1330-4ea6-b2bc-3e2bcaec3b94 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:28.431440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be6ef1d5-1330-4ea6-b2bc-3e2bcaec3b94 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:28.448522 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be6ef1d5-1330-4ea6-b2bc-3e2bcaec3b94 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:28.452594 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be6ef1d5-1330-4ea6-b2bc-3e2bcaec3b94 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:29.169108 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-be6ef1d5-1330-4ea6-b2bc-3e2bcaec3b94 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:29.180048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-be6ef1d5-1330-4ea6-b2bc-3e2bcaec3b94 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.812980 Jul 04 05:54:29.184396 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 27/74] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:28 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:29.446304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-bdbcb9a6-f4d4-42fd-93b5-2633f2c5e964 req-b7270b8d-1dc4-478e-8475-2a085b6d9797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13375831-faf3-4576-b695-7799f017bf2d", "tag": "0b8d0fac-ef15-4541-bfda-dfa9f8192c1f"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:29.459284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-bdbcb9a6-f4d4-42fd-93b5-2633f2c5e964 req-b7270b8d-1dc4-478e-8475-2a085b6d9797 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:29.460045 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-bdbcb9a6-f4d4-42fd-93b5-2633f2c5e964 req-b7270b8d-1dc4-478e-8475-2a085b6d9797 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:29.484316 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-bdbcb9a6-f4d4-42fd-93b5-2633f2c5e964 req-b7270b8d-1dc4-478e-8475-2a085b6d9797 service nova] Creating event network-changed:0b8d0fac-ef15-4541-bfda-dfa9f8192c1f for instance 13375831-faf3-4576-b695-7799f017bf2d on hv-cinder-79733 Jul 04 05:54:29.485095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-bdbcb9a6-f4d4-42fd-93b5-2633f2c5e964 req-b7270b8d-1dc4-478e-8475-2a085b6d9797 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 05:54:29.486428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ede209-6c6c-43d7-bbab-aef7cde7fde6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:29.487385 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ede209-6c6c-43d7-bbab-aef7cde7fde6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:29.488552 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ede209-6c6c-43d7-bbab-aef7cde7fde6 None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:29.489403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ede209-6c6c-43d7-bbab-aef7cde7fde6 None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:29.505184 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.compute.rpcapi [None req-e7ede209-6c6c-43d7-bbab-aef7cde7fde6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 05:54:29.520739 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ede209-6c6c-43d7-bbab-aef7cde7fde6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 05:54:29.559841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7ede209-6c6c-43d7-bbab-aef7cde7fde6 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369611 Jul 04 05:54:29.561986 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 28/75] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:29.573985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-452c2403-4555-4fcf-bcd5-4a5efa42fd29 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:29.575459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-452c2403-4555-4fcf-bcd5-4a5efa42fd29 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:29.596560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-452c2403-4555-4fcf-bcd5-4a5efa42fd29 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:29.597219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-452c2403-4555-4fcf-bcd5-4a5efa42fd29 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:29.600664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-452c2403-4555-4fcf-bcd5-4a5efa42fd29 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:29.601474 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-452c2403-4555-4fcf-bcd5-4a5efa42fd29 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:29.604130 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-966f778b-b883-4555-98b4-4851a9534d3a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:29.613270 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-966f778b-b883-4555-98b4-4851a9534d3a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 1.770673 Jul 04 05:54:29.624856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 48/76] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:27 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:29.630089 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-98f7fdd1-1418-4525-8d28-c145b81da0d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:29.641929 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-98f7fdd1-1418-4525-8d28-c145b81da0d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:29.650527 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98f7fdd1-1418-4525-8d28-c145b81da0d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:29.652185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98f7fdd1-1418-4525-8d28-c145b81da0d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:29.655579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98f7fdd1-1418-4525-8d28-c145b81da0d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:29.656198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98f7fdd1-1418-4525-8d28-c145b81da0d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:29.877237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-452c2403-4555-4fcf-bcd5-4a5efa42fd29 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:29.901124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-452c2403-4555-4fcf-bcd5-4a5efa42fd29 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1292 microversion: 2.1 time: 0.336842 Jul 04 05:54:29.901728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 29/77] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:29 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1292 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:30.059305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-98f7fdd1-1418-4525-8d28-c145b81da0d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:30.079759 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-98f7fdd1-1418-4525-8d28-c145b81da0d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:30.084005 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-98f7fdd1-1418-4525-8d28-c145b81da0d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:30.088481 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-98f7fdd1-1418-4525-8d28-c145b81da0d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.462192 Jul 04 05:54:30.102855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 49/78] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:29 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:30.202002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-050404d8-be4c-44c2-bd81-9830d528693f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:30.202767 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-050404d8-be4c-44c2-bd81-9830d528693f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:30.211290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-050404d8-be4c-44c2-bd81-9830d528693f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:30.211739 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-050404d8-be4c-44c2-bd81-9830d528693f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:30.212504 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-050404d8-be4c-44c2-bd81-9830d528693f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:30.212935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-050404d8-be4c-44c2-bd81-9830d528693f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:30.632828 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d2186ee5-a0f7-4b47-afbe-c895755e892d tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:30.634034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d2186ee5-a0f7-4b47-afbe-c895755e892d tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:30.642573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2186ee5-a0f7-4b47-afbe-c895755e892d tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:30.644899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2186ee5-a0f7-4b47-afbe-c895755e892d tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:30.645894 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2186ee5-a0f7-4b47-afbe-c895755e892d tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:30.649709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2186ee5-a0f7-4b47-afbe-c895755e892d tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:31.180945 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-050404d8-be4c-44c2-bd81-9830d528693f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:31.190027 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-050404d8-be4c-44c2-bd81-9830d528693f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.991582 Jul 04 05:54:31.210127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 30/79] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:30 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:31.221330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-155537da-f650-419c-8235-5b2ecfca2517 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:31.222309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-155537da-f650-419c-8235-5b2ecfca2517 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:31.245570 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-155537da-f650-419c-8235-5b2ecfca2517 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:31.246335 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-155537da-f650-419c-8235-5b2ecfca2517 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:31.247543 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-155537da-f650-419c-8235-5b2ecfca2517 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:31.248306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-155537da-f650-419c-8235-5b2ecfca2517 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:31.733007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d2186ee5-a0f7-4b47-afbe-c895755e892d tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:31.768972 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d2186ee5-a0f7-4b47-afbe-c895755e892d tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 1.140473 Jul 04 05:54:31.781957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 50/80] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:30 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:31.800102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1c40b597-2b96-4e11-b912-18118722fd24 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:31.801159 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1c40b597-2b96-4e11-b912-18118722fd24 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:31.824158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c40b597-2b96-4e11-b912-18118722fd24 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:31.824605 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c40b597-2b96-4e11-b912-18118722fd24 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:31.832411 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c40b597-2b96-4e11-b912-18118722fd24 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:31.832851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c40b597-2b96-4e11-b912-18118722fd24 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:31.950835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-155537da-f650-419c-8235-5b2ecfca2517 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:31.978874 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-155537da-f650-419c-8235-5b2ecfca2517 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1298 microversion: 2.1 time: 0.765736 Jul 04 05:54:31.984267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 31/81] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:31 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1298 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:32.212361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a97587a1-b63c-4bce-bf19-853e29c75800 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:32.213078 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a97587a1-b63c-4bce-bf19-853e29c75800 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:32.228452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a97587a1-b63c-4bce-bf19-853e29c75800 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:32.228920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a97587a1-b63c-4bce-bf19-853e29c75800 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:32.229688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a97587a1-b63c-4bce-bf19-853e29c75800 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:32.230124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a97587a1-b63c-4bce-bf19-853e29c75800 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:32.424941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:32.454616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c40b597-2b96-4e11-b912-18118722fd24 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:32.488348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c40b597-2b96-4e11-b912-18118722fd24 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:32.489961 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c40b597-2b96-4e11-b912-18118722fd24 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:32.499012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1c40b597-2b96-4e11-b912-18118722fd24 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.716719 Jul 04 05:54:32.504948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 51/82] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:31 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:32.648247 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a97587a1-b63c-4bce-bf19-853e29c75800 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:32.659892 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a97587a1-b63c-4bce-bf19-853e29c75800 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.451301 Jul 04 05:54:32.671357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 32/83] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:32 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:32.787379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5fe5b92e-6ca3-409c-a603-f07b5b03fc4b tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:32.788119 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5fe5b92e-6ca3-409c-a603-f07b5b03fc4b tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:32.789472 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-ea5a8f26-01aa-46c3-bef5-54b84692bed3 req-305a10b4-647d-458b-8871-362088c2ee39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178121f0-a865-467e-a46a-069b621b6d17", "tag": "27020a65-ee8e-4790-a27b-3983dfc85818"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:32.809519 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fe5b92e-6ca3-409c-a603-f07b5b03fc4b tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:32.810148 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fe5b92e-6ca3-409c-a603-f07b5b03fc4b tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:32.811100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fe5b92e-6ca3-409c-a603-f07b5b03fc4b tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:32.811842 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fe5b92e-6ca3-409c-a603-f07b5b03fc4b tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:32.847898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-ea5a8f26-01aa-46c3-bef5-54b84692bed3 req-305a10b4-647d-458b-8871-362088c2ee39 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:32.850370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-ea5a8f26-01aa-46c3-bef5-54b84692bed3 req-305a10b4-647d-458b-8871-362088c2ee39 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:32.932133 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-ea5a8f26-01aa-46c3-bef5-54b84692bed3 req-305a10b4-647d-458b-8871-362088c2ee39 service nova] Creating event network-changed:27020a65-ee8e-4790-a27b-3983dfc85818 for instance 178121f0-a865-467e-a46a-069b621b6d17 on hv-cinder-79733 Jul 04 05:54:32.933916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-ea5a8f26-01aa-46c3-bef5-54b84692bed3 req-305a10b4-647d-458b-8871-362088c2ee39 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117607) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 05:54:32.935278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c45434bf-3a3c-49c4-b140-c08655249ccf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:32.940140 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c45434bf-3a3c-49c4-b140-c08655249ccf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:32.941239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c45434bf-3a3c-49c4-b140-c08655249ccf None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:32.947554 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c45434bf-3a3c-49c4-b140-c08655249ccf None None] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:32.992711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.compute.rpcapi [None req-c45434bf-3a3c-49c4-b140-c08655249ccf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 05:54:32.997741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c45434bf-3a3c-49c4-b140-c08655249ccf None None] Releasing lock "compute-rpcapi-router" {{(pid=117607) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 05:54:33.060806 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c45434bf-3a3c-49c4-b140-c08655249ccf None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.290886 Jul 04 05:54:33.063351 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 52/84] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:54:33.069350 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-47e7c594-35f1-4b49-b371-097f0e9413e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:33.070052 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-47e7c594-35f1-4b49-b371-097f0e9413e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:33.114482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47e7c594-35f1-4b49-b371-097f0e9413e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:33.115137 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47e7c594-35f1-4b49-b371-097f0e9413e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:33.118835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47e7c594-35f1-4b49-b371-097f0e9413e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:33.123989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47e7c594-35f1-4b49-b371-097f0e9413e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:33.622233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5fe5b92e-6ca3-409c-a603-f07b5b03fc4b tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:33.632186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5fe5b92e-6ca3-409c-a603-f07b5b03fc4b tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.849487 Jul 04 05:54:33.636307 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 33/85] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:32 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:33.648251 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-891ece86-198f-4c8e-8abe-01abe4bba1b5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:33.648884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-891ece86-198f-4c8e-8abe-01abe4bba1b5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:33.661539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-891ece86-198f-4c8e-8abe-01abe4bba1b5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:33.661994 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-891ece86-198f-4c8e-8abe-01abe4bba1b5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:33.662762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-891ece86-198f-4c8e-8abe-01abe4bba1b5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:33.663187 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-891ece86-198f-4c8e-8abe-01abe4bba1b5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:33.796910 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-47e7c594-35f1-4b49-b371-097f0e9413e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:33.807846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-47e7c594-35f1-4b49-b371-097f0e9413e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1298 microversion: 2.1 time: 0.741831 Jul 04 05:54:33.823764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 53/86] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:33 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1298 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:33.839127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-29e7b577-0e5a-4221-823f-508e3e2c7fb0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:33.839874 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-29e7b577-0e5a-4221-823f-508e3e2c7fb0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:33.845126 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:33.860162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29e7b577-0e5a-4221-823f-508e3e2c7fb0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:33.860650 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29e7b577-0e5a-4221-823f-508e3e2c7fb0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:33.861594 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29e7b577-0e5a-4221-823f-508e3e2c7fb0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:33.862033 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29e7b577-0e5a-4221-823f-508e3e2c7fb0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:33.956314 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-891ece86-198f-4c8e-8abe-01abe4bba1b5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:33.967623 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-891ece86-198f-4c8e-8abe-01abe4bba1b5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:33.969242 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-891ece86-198f-4c8e-8abe-01abe4bba1b5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:33.970359 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-891ece86-198f-4c8e-8abe-01abe4bba1b5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.332797 Jul 04 05:54:33.970919 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 34/87] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:33 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:34.318590 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29e7b577-0e5a-4221-823f-508e3e2c7fb0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:34.329696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=91 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:34.345921 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-29e7b577-0e5a-4221-823f-508e3e2c7fb0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.520854 Jul 04 05:54:34.346790 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 54/88] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:33 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:34.653217 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-03f7b67c-7948-4413-8c7f-719a6025d3a1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:34.654133 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-03f7b67c-7948-4413-8c7f-719a6025d3a1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:34.670464 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03f7b67c-7948-4413-8c7f-719a6025d3a1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:34.671098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03f7b67c-7948-4413-8c7f-719a6025d3a1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:34.672518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03f7b67c-7948-4413-8c7f-719a6025d3a1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:34.674644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03f7b67c-7948-4413-8c7f-719a6025d3a1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:34.720496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-7f08a451-c6e0-4eb3-863f-d1546d88ad63 req-be6f08ba-e6b6-4eae-bb29-fd6629b5ba9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9979d81a-1d93-423a-b99e-74434186140a", "tag": "1156d5a0-a197-4c61-8b92-ca56849134a9"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:34.736046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-7f08a451-c6e0-4eb3-863f-d1546d88ad63 req-be6f08ba-e6b6-4eae-bb29-fd6629b5ba9b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:34.736509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-7f08a451-c6e0-4eb3-863f-d1546d88ad63 req-be6f08ba-e6b6-4eae-bb29-fd6629b5ba9b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:34.771541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-7f08a451-c6e0-4eb3-863f-d1546d88ad63 req-be6f08ba-e6b6-4eae-bb29-fd6629b5ba9b service nova] Creating event network-changed:1156d5a0-a197-4c61-8b92-ca56849134a9 for instance 9979d81a-1d93-423a-b99e-74434186140a on hv-cinder-79733 Jul 04 05:54:34.784569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-7f08a451-c6e0-4eb3-863f-d1546d88ad63 req-be6f08ba-e6b6-4eae-bb29-fd6629b5ba9b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189153 Jul 04 05:54:34.787156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 35/89] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:34.825014 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-17d2b1bb-677a-4821-ac84-7dbbe5629739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:34.825714 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-17d2b1bb-677a-4821-ac84-7dbbe5629739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:34.859275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17d2b1bb-677a-4821-ac84-7dbbe5629739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:34.860077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17d2b1bb-677a-4821-ac84-7dbbe5629739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:34.862572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17d2b1bb-677a-4821-ac84-7dbbe5629739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:34.863391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17d2b1bb-677a-4821-ac84-7dbbe5629739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:34.887976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-03f7b67c-7948-4413-8c7f-719a6025d3a1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:34.898868 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-03f7b67c-7948-4413-8c7f-719a6025d3a1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.249614 Jul 04 05:54:34.900131 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 55/90] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:34 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:34.989376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2bbdc210-1849-46f2-92be-42eb660c6765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:34.989987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2bbdc210-1849-46f2-92be-42eb660c6765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:35.001400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bbdc210-1849-46f2-92be-42eb660c6765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:35.001865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bbdc210-1849-46f2-92be-42eb660c6765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:35.002567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bbdc210-1849-46f2-92be-42eb660c6765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:35.003076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bbdc210-1849-46f2-92be-42eb660c6765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:35.082372 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-17d2b1bb-677a-4821-ac84-7dbbe5629739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:35.098592 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-17d2b1bb-677a-4821-ac84-7dbbe5629739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.277700 Jul 04 05:54:35.100708 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 36/91] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:34 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:35.194819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2bbdc210-1849-46f2-92be-42eb660c6765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:35.205815 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2bbdc210-1849-46f2-92be-42eb660c6765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:35.208703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2bbdc210-1849-46f2-92be-42eb660c6765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:35.209915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2bbdc210-1849-46f2-92be-42eb660c6765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.224801 Jul 04 05:54:35.210556 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 56/92] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:34 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:54:35.363789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3fb6aa18-ed97-42c7-a701-8bf06a54b4cb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:35.364464 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3fb6aa18-ed97-42c7-a701-8bf06a54b4cb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:35.370226 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:35.371908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fb6aa18-ed97-42c7-a701-8bf06a54b4cb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:35.372625 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fb6aa18-ed97-42c7-a701-8bf06a54b4cb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:35.373776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fb6aa18-ed97-42c7-a701-8bf06a54b4cb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:35.374386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fb6aa18-ed97-42c7-a701-8bf06a54b4cb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:35.645909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3fb6aa18-ed97-42c7-a701-8bf06a54b4cb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:35.653436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:35.673162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3fb6aa18-ed97-42c7-a701-8bf06a54b4cb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.305288 Jul 04 05:54:35.673805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 37/93] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:35 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:35.917471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cda966c6-3077-46c1-99e0-319d5afc9435 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:35.918314 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cda966c6-3077-46c1-99e0-319d5afc9435 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:35.932478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cda966c6-3077-46c1-99e0-319d5afc9435 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:35.935685 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cda966c6-3077-46c1-99e0-319d5afc9435 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:35.937793 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cda966c6-3077-46c1-99e0-319d5afc9435 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:35.952539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cda966c6-3077-46c1-99e0-319d5afc9435 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:36.121539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93b30a13-5384-481e-be2c-55b87e7778d6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:36.122142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-93b30a13-5384-481e-be2c-55b87e7778d6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:36.138748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93b30a13-5384-481e-be2c-55b87e7778d6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:36.139227 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93b30a13-5384-481e-be2c-55b87e7778d6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:36.143050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93b30a13-5384-481e-be2c-55b87e7778d6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:36.143971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93b30a13-5384-481e-be2c-55b87e7778d6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:36.405196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cda966c6-3077-46c1-99e0-319d5afc9435 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:36.414493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cda966c6-3077-46c1-99e0-319d5afc9435 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.501975 Jul 04 05:54:36.415071 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 57/94] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:35 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:36.421997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e20ddb47-873e-47fa-b81d-5775ff18b0ee tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:36.424298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e20ddb47-873e-47fa-b81d-5775ff18b0ee tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:36.436795 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e20ddb47-873e-47fa-b81d-5775ff18b0ee tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:36.437361 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e20ddb47-873e-47fa-b81d-5775ff18b0ee tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:36.438243 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e20ddb47-873e-47fa-b81d-5775ff18b0ee tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:36.439163 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e20ddb47-873e-47fa-b81d-5775ff18b0ee tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:36.562217 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-93b30a13-5384-481e-be2c-55b87e7778d6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:36.570583 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-93b30a13-5384-481e-be2c-55b87e7778d6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.457099 Jul 04 05:54:36.572531 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 38/95] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:36 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:36.618863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e20ddb47-873e-47fa-b81d-5775ff18b0ee tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:36.629021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e20ddb47-873e-47fa-b81d-5775ff18b0ee tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:36.632324 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e20ddb47-873e-47fa-b81d-5775ff18b0ee tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:36.633813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e20ddb47-873e-47fa-b81d-5775ff18b0ee tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.217695 Jul 04 05:54:36.634923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 58/96] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:36 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:36.692597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7bd0f645-2599-43ba-8b0e-38b4a6f7ccb6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:36.693223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7bd0f645-2599-43ba-8b0e-38b4a6f7ccb6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:36.705383 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bd0f645-2599-43ba-8b0e-38b4a6f7ccb6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:36.705834 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bd0f645-2599-43ba-8b0e-38b4a6f7ccb6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:36.709579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bd0f645-2599-43ba-8b0e-38b4a6f7ccb6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:36.710036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bd0f645-2599-43ba-8b0e-38b4a6f7ccb6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:36.949944 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7bd0f645-2599-43ba-8b0e-38b4a6f7ccb6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:36.960157 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7bd0f645-2599-43ba-8b0e-38b4a6f7ccb6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.272476 Jul 04 05:54:36.961113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 39/97] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:36 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:37.022318 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-645f2753-5e1d-4634-ad13-1c2d6dc60ba5 req-465921d2-5ca0-428b-b8a8-a79cabbde99a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a604de-7fc4-4f6c-9fce-acd174439f47", "tag": "e8ce7b84-57c9-44e0-97c0-aac43b68abec"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:37.037186 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-645f2753-5e1d-4634-ad13-1c2d6dc60ba5 req-465921d2-5ca0-428b-b8a8-a79cabbde99a service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:37.052467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-645f2753-5e1d-4634-ad13-1c2d6dc60ba5 req-465921d2-5ca0-428b-b8a8-a79cabbde99a service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:37.111600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-645f2753-5e1d-4634-ad13-1c2d6dc60ba5 req-465921d2-5ca0-428b-b8a8-a79cabbde99a service nova] Creating event network-changed:e8ce7b84-57c9-44e0-97c0-aac43b68abec for instance 91a604de-7fc4-4f6c-9fce-acd174439f47 on hv-cinder-79733 Jul 04 05:54:37.126962 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-645f2753-5e1d-4634-ad13-1c2d6dc60ba5 req-465921d2-5ca0-428b-b8a8-a79cabbde99a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108300 Jul 04 05:54:37.132660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 59/98] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:37.438470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5ca0d0d8-36d1-4113-ad2c-7082508356f6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:37.439185 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5ca0d0d8-36d1-4113-ad2c-7082508356f6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:37.441389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:37.447265 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ca0d0d8-36d1-4113-ad2c-7082508356f6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:37.448223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ca0d0d8-36d1-4113-ad2c-7082508356f6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:37.450587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ca0d0d8-36d1-4113-ad2c-7082508356f6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:37.450587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ca0d0d8-36d1-4113-ad2c-7082508356f6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:37.590004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1dbfcea8-5ce1-4149-bfdd-e410f0a21cdd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:37.591344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1dbfcea8-5ce1-4149-bfdd-e410f0a21cdd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:37.601725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dbfcea8-5ce1-4149-bfdd-e410f0a21cdd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:37.605251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dbfcea8-5ce1-4149-bfdd-e410f0a21cdd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:37.608975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dbfcea8-5ce1-4149-bfdd-e410f0a21cdd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:37.609555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dbfcea8-5ce1-4149-bfdd-e410f0a21cdd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:37.718521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=28 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:37.796261 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5ca0d0d8-36d1-4113-ad2c-7082508356f6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:37.811203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5ca0d0d8-36d1-4113-ad2c-7082508356f6 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.377810 Jul 04 05:54:37.812428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 40/99] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:37 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:37.819279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-beb6b02b-b406-4af3-a229-3b3a746d01d8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:37.820084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-beb6b02b-b406-4af3-a229-3b3a746d01d8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:37.845999 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-beb6b02b-b406-4af3-a229-3b3a746d01d8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:37.846482 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-beb6b02b-b406-4af3-a229-3b3a746d01d8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:37.848455 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1dbfcea8-5ce1-4149-bfdd-e410f0a21cdd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:37.848880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-beb6b02b-b406-4af3-a229-3b3a746d01d8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:37.849357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-beb6b02b-b406-4af3-a229-3b3a746d01d8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:37.861224 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1dbfcea8-5ce1-4149-bfdd-e410f0a21cdd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.276366 Jul 04 05:54:37.865173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 60/100] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:37 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:37.984443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b81b83c2-8131-42b8-9d1b-a472c4603cbd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:37.985234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b81b83c2-8131-42b8-9d1b-a472c4603cbd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:37.994520 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b81b83c2-8131-42b8-9d1b-a472c4603cbd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:37.995187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b81b83c2-8131-42b8-9d1b-a472c4603cbd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:37.996329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b81b83c2-8131-42b8-9d1b-a472c4603cbd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:37.996897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b81b83c2-8131-42b8-9d1b-a472c4603cbd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:38.029594 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-beb6b02b-b406-4af3-a229-3b3a746d01d8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:38.051742 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-beb6b02b-b406-4af3-a229-3b3a746d01d8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:38.053759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-beb6b02b-b406-4af3-a229-3b3a746d01d8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:38.055059 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-beb6b02b-b406-4af3-a229-3b3a746d01d8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.241088 Jul 04 05:54:38.056124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 41/101] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:37 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:38.158231 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b81b83c2-8131-42b8-9d1b-a472c4603cbd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:38.166357 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b81b83c2-8131-42b8-9d1b-a472c4603cbd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.192681 Jul 04 05:54:38.167052 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 61/102] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:37 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:38.831466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6b66517b-3804-448f-b183-44a6020a82f5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:38.832242 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6b66517b-3804-448f-b183-44a6020a82f5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:38.840059 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b66517b-3804-448f-b183-44a6020a82f5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:38.841127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b66517b-3804-448f-b183-44a6020a82f5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:38.842137 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b66517b-3804-448f-b183-44a6020a82f5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:38.842794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b66517b-3804-448f-b183-44a6020a82f5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:38.880844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-930a07bc-59cb-4817-a11d-691f8490ebcb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:38.881455 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-930a07bc-59cb-4817-a11d-691f8490ebcb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:38.888061 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-930a07bc-59cb-4817-a11d-691f8490ebcb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:38.888507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-930a07bc-59cb-4817-a11d-691f8490ebcb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:38.889649 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-930a07bc-59cb-4817-a11d-691f8490ebcb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:38.890085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-930a07bc-59cb-4817-a11d-691f8490ebcb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:38.991550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b66517b-3804-448f-b183-44a6020a82f5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:39.009465 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6b66517b-3804-448f-b183-44a6020a82f5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.183378 Jul 04 05:54:39.020300 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 42/103] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:38 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:39.042099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-930a07bc-59cb-4817-a11d-691f8490ebcb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:39.049809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-930a07bc-59cb-4817-a11d-691f8490ebcb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.173168 Jul 04 05:54:39.050824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 62/104] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:38 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:39.073376 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3b7fb48a-5bb5-4e80-bff7-a1b734e5b8d3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:39.073975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3b7fb48a-5bb5-4e80-bff7-a1b734e5b8d3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:39.079857 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b7fb48a-5bb5-4e80-bff7-a1b734e5b8d3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:39.080275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b7fb48a-5bb5-4e80-bff7-a1b734e5b8d3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:39.081048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b7fb48a-5bb5-4e80-bff7-a1b734e5b8d3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:39.081450 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b7fb48a-5bb5-4e80-bff7-a1b734e5b8d3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:39.184253 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-107b1edd-c1d1-4670-88f6-a6791a9b698a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:39.185000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-107b1edd-c1d1-4670-88f6-a6791a9b698a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:39.201321 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-107b1edd-c1d1-4670-88f6-a6791a9b698a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:39.201763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-107b1edd-c1d1-4670-88f6-a6791a9b698a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:39.202585 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-107b1edd-c1d1-4670-88f6-a6791a9b698a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:39.203011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-107b1edd-c1d1-4670-88f6-a6791a9b698a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:39.226885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3b7fb48a-5bb5-4e80-bff7-a1b734e5b8d3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:39.235485 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3b7fb48a-5bb5-4e80-bff7-a1b734e5b8d3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:39.245920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3b7fb48a-5bb5-4e80-bff7-a1b734e5b8d3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:39.247073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3b7fb48a-5bb5-4e80-bff7-a1b734e5b8d3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.177611 Jul 04 05:54:39.247656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 43/105] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:39 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:39.338993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-107b1edd-c1d1-4670-88f6-a6791a9b698a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:39.347018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-107b1edd-c1d1-4670-88f6-a6791a9b698a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.166504 Jul 04 05:54:39.348224 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 63/106] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:39 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:40.029282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0f7d28a6-2572-4753-98db-0adcd258a6e1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:40.030048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0f7d28a6-2572-4753-98db-0adcd258a6e1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:40.031972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:40.037423 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f7d28a6-2572-4753-98db-0adcd258a6e1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:40.037869 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f7d28a6-2572-4753-98db-0adcd258a6e1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:40.038633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f7d28a6-2572-4753-98db-0adcd258a6e1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:40.039063 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f7d28a6-2572-4753-98db-0adcd258a6e1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:40.067432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0e3ed3e8-d5d5-4b68-9920-df8dfb4ece8f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:40.068040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0e3ed3e8-d5d5-4b68-9920-df8dfb4ece8f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:40.074734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e3ed3e8-d5d5-4b68-9920-df8dfb4ece8f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:40.075181 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e3ed3e8-d5d5-4b68-9920-df8dfb4ece8f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:40.075992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e3ed3e8-d5d5-4b68-9920-df8dfb4ece8f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:40.076423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e3ed3e8-d5d5-4b68-9920-df8dfb4ece8f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:40.173977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0f7d28a6-2572-4753-98db-0adcd258a6e1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:40.182408 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0f7d28a6-2572-4753-98db-0adcd258a6e1 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.159516 Jul 04 05:54:40.182988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 44/107] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:40 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:40.205733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e3ed3e8-d5d5-4b68-9920-df8dfb4ece8f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:40.213318 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0e3ed3e8-d5d5-4b68-9920-df8dfb4ece8f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.149807 Jul 04 05:54:40.213887 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 64/108] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:40 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:40.268470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c42f0cae-ff94-4def-a6f9-e6ec01d0e6ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:40.269446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c42f0cae-ff94-4def-a6f9-e6ec01d0e6ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:40.279820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c42f0cae-ff94-4def-a6f9-e6ec01d0e6ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:40.280454 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c42f0cae-ff94-4def-a6f9-e6ec01d0e6ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:40.281730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c42f0cae-ff94-4def-a6f9-e6ec01d0e6ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:40.282412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c42f0cae-ff94-4def-a6f9-e6ec01d0e6ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:40.363744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-20cec9dc-05a2-4387-886b-6d8ad7448d43 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:40.364440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-20cec9dc-05a2-4387-886b-6d8ad7448d43 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:40.370680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20cec9dc-05a2-4387-886b-6d8ad7448d43 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:40.371128 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20cec9dc-05a2-4387-886b-6d8ad7448d43 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:40.372095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20cec9dc-05a2-4387-886b-6d8ad7448d43 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:40.372339 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20cec9dc-05a2-4387-886b-6d8ad7448d43 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:40.423034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c42f0cae-ff94-4def-a6f9-e6ec01d0e6ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:40.431475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c42f0cae-ff94-4def-a6f9-e6ec01d0e6ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:40.432974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c42f0cae-ff94-4def-a6f9-e6ec01d0e6ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:40.434138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c42f0cae-ff94-4def-a6f9-e6ec01d0e6ae tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.172282 Jul 04 05:54:40.435299 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 45/109] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:40 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:40.513640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20cec9dc-05a2-4387-886b-6d8ad7448d43 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:40.521772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-20cec9dc-05a2-4387-886b-6d8ad7448d43 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.161932 Jul 04 05:54:40.522349 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 65/110] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:40 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:41.199385 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f26050b1-97c7-4e0c-a5bd-7fa7708d27cb tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:41.200019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f26050b1-97c7-4e0c-a5bd-7fa7708d27cb tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:41.206508 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f26050b1-97c7-4e0c-a5bd-7fa7708d27cb tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:41.206957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f26050b1-97c7-4e0c-a5bd-7fa7708d27cb tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:41.207748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f26050b1-97c7-4e0c-a5bd-7fa7708d27cb tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:41.208185 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f26050b1-97c7-4e0c-a5bd-7fa7708d27cb tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:41.230000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-588ffd61-106d-49c5-8be3-75f787bfb887 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:41.230609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-588ffd61-106d-49c5-8be3-75f787bfb887 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:41.239157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-588ffd61-106d-49c5-8be3-75f787bfb887 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:41.241138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-588ffd61-106d-49c5-8be3-75f787bfb887 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:41.242999 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-588ffd61-106d-49c5-8be3-75f787bfb887 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:41.243457 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-588ffd61-106d-49c5-8be3-75f787bfb887 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:41.400225 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f26050b1-97c7-4e0c-a5bd-7fa7708d27cb tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:41.402555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-588ffd61-106d-49c5-8be3-75f787bfb887 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:41.410684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-588ffd61-106d-49c5-8be3-75f787bfb887 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.184353 Jul 04 05:54:41.411273 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 66/111] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:41 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:41.414509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f26050b1-97c7-4e0c-a5bd-7fa7708d27cb tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.218797 Jul 04 05:54:41.415083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 46/112] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:41 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:41.451941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a1a36f5e-0ec2-4a4b-953a-528cf8b711e3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:41.452549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1a36f5e-0ec2-4a4b-953a-528cf8b711e3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:41.458979 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1a36f5e-0ec2-4a4b-953a-528cf8b711e3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:41.459440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1a36f5e-0ec2-4a4b-953a-528cf8b711e3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:41.460201 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1a36f5e-0ec2-4a4b-953a-528cf8b711e3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:41.460628 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1a36f5e-0ec2-4a4b-953a-528cf8b711e3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:41.538292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3179e9b4-9da0-48ff-9c86-634bb7d6b237 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:41.539222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3179e9b4-9da0-48ff-9c86-634bb7d6b237 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:41.546326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3179e9b4-9da0-48ff-9c86-634bb7d6b237 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:41.546949 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3179e9b4-9da0-48ff-9c86-634bb7d6b237 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:41.547934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3179e9b4-9da0-48ff-9c86-634bb7d6b237 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:41.548333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3179e9b4-9da0-48ff-9c86-634bb7d6b237 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:41.591533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1a36f5e-0ec2-4a4b-953a-528cf8b711e3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:41.600297 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1a36f5e-0ec2-4a4b-953a-528cf8b711e3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:41.601966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1a36f5e-0ec2-4a4b-953a-528cf8b711e3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:41.603070 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a1a36f5e-0ec2-4a4b-953a-528cf8b711e3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.155186 Jul 04 05:54:41.607281 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 67/113] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:41 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:41.706445 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3179e9b4-9da0-48ff-9c86-634bb7d6b237 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:41.714068 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3179e9b4-9da0-48ff-9c86-634bb7d6b237 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.179814 Jul 04 05:54:41.714633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 47/114] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:41 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:42.429095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-46f4e01e-8b29-45bd-bb4a-6a3ff104268a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:42.429971 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-46f4e01e-8b29-45bd-bb4a-6a3ff104268a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:42.435542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42234e98-2266-4beb-8d06-deabc09639a5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:42.437966 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-42234e98-2266-4beb-8d06-deabc09639a5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:42.440429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46f4e01e-8b29-45bd-bb4a-6a3ff104268a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:42.440981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46f4e01e-8b29-45bd-bb4a-6a3ff104268a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:42.446940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42234e98-2266-4beb-8d06-deabc09639a5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:42.447477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42234e98-2266-4beb-8d06-deabc09639a5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:42.448373 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42234e98-2266-4beb-8d06-deabc09639a5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:42.448816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42234e98-2266-4beb-8d06-deabc09639a5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:42.452102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46f4e01e-8b29-45bd-bb4a-6a3ff104268a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:42.452932 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46f4e01e-8b29-45bd-bb4a-6a3ff104268a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:42.596939 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-42234e98-2266-4beb-8d06-deabc09639a5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:42.605593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-42234e98-2266-4beb-8d06-deabc09639a5 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.178202 Jul 04 05:54:42.606200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 48/115] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:42 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:42.617224 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-46f4e01e-8b29-45bd-bb4a-6a3ff104268a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:42.623132 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe841cbb-7b58-450e-a9d2-467d400e4306 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:42.623785 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe841cbb-7b58-450e-a9d2-467d400e4306 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:42.625669 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-46f4e01e-8b29-45bd-bb4a-6a3ff104268a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.201458 Jul 04 05:54:42.626238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 68/116] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:42 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:42.629929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe841cbb-7b58-450e-a9d2-467d400e4306 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:42.630371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe841cbb-7b58-450e-a9d2-467d400e4306 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:42.631142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe841cbb-7b58-450e-a9d2-467d400e4306 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:42.631593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe841cbb-7b58-450e-a9d2-467d400e4306 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:42.734114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6ebbdd77-b951-47f7-9cdc-5e1eaab4abf7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:42.734833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6ebbdd77-b951-47f7-9cdc-5e1eaab4abf7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:42.745638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ebbdd77-b951-47f7-9cdc-5e1eaab4abf7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:42.746331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ebbdd77-b951-47f7-9cdc-5e1eaab4abf7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:42.747609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ebbdd77-b951-47f7-9cdc-5e1eaab4abf7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:42.748281 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ebbdd77-b951-47f7-9cdc-5e1eaab4abf7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:42.863560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe841cbb-7b58-450e-a9d2-467d400e4306 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:42.873338 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe841cbb-7b58-450e-a9d2-467d400e4306 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:42.874890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe841cbb-7b58-450e-a9d2-467d400e4306 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:42.876162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe841cbb-7b58-450e-a9d2-467d400e4306 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.257778 Jul 04 05:54:42.877261 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 49/117] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:42 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:42.924709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6ebbdd77-b951-47f7-9cdc-5e1eaab4abf7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:42.935185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6ebbdd77-b951-47f7-9cdc-5e1eaab4abf7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.205869 Jul 04 05:54:42.936467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 69/118] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:42 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:43.626013 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0b7b99a0-10e8-4fd2-a1e9-fd311ed58c6c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:43.626608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0b7b99a0-10e8-4fd2-a1e9-fd311ed58c6c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:43.633245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b7b99a0-10e8-4fd2-a1e9-fd311ed58c6c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:43.633897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b7b99a0-10e8-4fd2-a1e9-fd311ed58c6c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:43.634670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b7b99a0-10e8-4fd2-a1e9-fd311ed58c6c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:43.635106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b7b99a0-10e8-4fd2-a1e9-fd311ed58c6c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:43.643731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-454df4b0-023a-4372-b6e8-557b3a3380f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:43.644593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-454df4b0-023a-4372-b6e8-557b3a3380f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:43.647976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:43.652673 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-454df4b0-023a-4372-b6e8-557b3a3380f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:43.653570 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-454df4b0-023a-4372-b6e8-557b3a3380f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:43.654624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-454df4b0-023a-4372-b6e8-557b3a3380f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:43.655117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-454df4b0-023a-4372-b6e8-557b3a3380f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:43.807740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-454df4b0-023a-4372-b6e8-557b3a3380f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:43.815529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-454df4b0-023a-4372-b6e8-557b3a3380f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.176104 Jul 04 05:54:43.816109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 70/119] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:43 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:43.895494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-455a49c0-31c2-4eb0-b0dc-886b309aae50 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:43.896240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-455a49c0-31c2-4eb0-b0dc-886b309aae50 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:43.903422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-455a49c0-31c2-4eb0-b0dc-886b309aae50 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:43.903938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-455a49c0-31c2-4eb0-b0dc-886b309aae50 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:43.904843 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-455a49c0-31c2-4eb0-b0dc-886b309aae50 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:43.905466 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-455a49c0-31c2-4eb0-b0dc-886b309aae50 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:43.929920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0b7b99a0-10e8-4fd2-a1e9-fd311ed58c6c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:43.941925 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0b7b99a0-10e8-4fd2-a1e9-fd311ed58c6c tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.321134 Jul 04 05:54:43.942740 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 50/120] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:43 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:43.957925 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2dfe9d7c-1023-4767-92cc-dca113354d6d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:43.958506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2dfe9d7c-1023-4767-92cc-dca113354d6d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:43.965103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dfe9d7c-1023-4767-92cc-dca113354d6d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:43.966081 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dfe9d7c-1023-4767-92cc-dca113354d6d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:43.967041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dfe9d7c-1023-4767-92cc-dca113354d6d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:43.967648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dfe9d7c-1023-4767-92cc-dca113354d6d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:44.152836 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-455a49c0-31c2-4eb0-b0dc-886b309aae50 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:44.162235 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-455a49c0-31c2-4eb0-b0dc-886b309aae50 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:44.163774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-455a49c0-31c2-4eb0-b0dc-886b309aae50 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:44.164892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-455a49c0-31c2-4eb0-b0dc-886b309aae50 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.274412 Jul 04 05:54:44.167705 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 71/121] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:43 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:54:44.201336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2dfe9d7c-1023-4767-92cc-dca113354d6d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:44.209742 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2dfe9d7c-1023-4767-92cc-dca113354d6d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.255631 Jul 04 05:54:44.211597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 51/122] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:43 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:44.736513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-3b03350d-edce-42e2-b592-6843023b8aff req-92e26ab8-f153-4d40-887c-a41e621e77fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13375831-faf3-4576-b695-7799f017bf2d", "name": "network-vif-plugged", "status": "completed", "tag": "0b8d0fac-ef15-4541-bfda-dfa9f8192c1f"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:44.746154 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-3b03350d-edce-42e2-b592-6843023b8aff req-92e26ab8-f153-4d40-887c-a41e621e77fa service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:44.746607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-3b03350d-edce-42e2-b592-6843023b8aff req-92e26ab8-f153-4d40-887c-a41e621e77fa service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:44.758122 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:44.760841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-3b03350d-edce-42e2-b592-6843023b8aff req-92e26ab8-f153-4d40-887c-a41e621e77fa service nova] Creating event network-vif-plugged:0b8d0fac-ef15-4541-bfda-dfa9f8192c1f for instance 13375831-faf3-4576-b695-7799f017bf2d on hv-cinder-79733 Jul 04 05:54:44.768711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-3b03350d-edce-42e2-b592-6843023b8aff req-92e26ab8-f153-4d40-887c-a41e621e77fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134706 Jul 04 05:54:44.773370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 72/123] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:44.832827 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-53b54b4c-ac39-4c2e-8717-9d192cde5e1d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:44.833445 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-53b54b4c-ac39-4c2e-8717-9d192cde5e1d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:44.843655 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53b54b4c-ac39-4c2e-8717-9d192cde5e1d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:44.844106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53b54b4c-ac39-4c2e-8717-9d192cde5e1d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:44.844938 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53b54b4c-ac39-4c2e-8717-9d192cde5e1d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:44.845371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53b54b4c-ac39-4c2e-8717-9d192cde5e1d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:44.961156 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7f00f8cd-ae2b-4dbb-b573-39ede5598d63 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:44.961976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7f00f8cd-ae2b-4dbb-b573-39ede5598d63 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:44.990730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f00f8cd-ae2b-4dbb-b573-39ede5598d63 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:44.993506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f00f8cd-ae2b-4dbb-b573-39ede5598d63 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:44.999764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f00f8cd-ae2b-4dbb-b573-39ede5598d63 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:45.000401 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f00f8cd-ae2b-4dbb-b573-39ede5598d63 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:45.626452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-53b54b4c-ac39-4c2e-8717-9d192cde5e1d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:45.637562 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-53b54b4c-ac39-4c2e-8717-9d192cde5e1d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.805921 Jul 04 05:54:45.649122 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 52/124] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:44 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:45.677381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b2ce1c5c-90ad-4b6b-ad42-639e9be51f09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:45.679593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b2ce1c5c-90ad-4b6b-ad42-639e9be51f09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:45.697902 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b2ce1c5c-90ad-4b6b-ad42-639e9be51f09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:45.698627 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b2ce1c5c-90ad-4b6b-ad42-639e9be51f09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:45.701668 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b2ce1c5c-90ad-4b6b-ad42-639e9be51f09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:45.702345 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b2ce1c5c-90ad-4b6b-ad42-639e9be51f09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:45.905327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7f00f8cd-ae2b-4dbb-b573-39ede5598d63 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:45.916186 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7f00f8cd-ae2b-4dbb-b573-39ede5598d63 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.959477 Jul 04 05:54:45.917073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 73/125] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:44 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:45.924111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2f134622-6328-4241-95b7-d64e5bec115c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:45.925294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2f134622-6328-4241-95b7-d64e5bec115c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:45.932642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f134622-6328-4241-95b7-d64e5bec115c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:45.933885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f134622-6328-4241-95b7-d64e5bec115c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:45.935888 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f134622-6328-4241-95b7-d64e5bec115c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:45.936593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f134622-6328-4241-95b7-d64e5bec115c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:46.037323 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b2ce1c5c-90ad-4b6b-ad42-639e9be51f09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:46.051513 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b2ce1c5c-90ad-4b6b-ad42-639e9be51f09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:46.053416 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b2ce1c5c-90ad-4b6b-ad42-639e9be51f09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:46.054793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b2ce1c5c-90ad-4b6b-ad42-639e9be51f09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.386730 Jul 04 05:54:46.065690 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 53/126] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:45 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:46.214509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2f134622-6328-4241-95b7-d64e5bec115c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:46.229769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2f134622-6328-4241-95b7-d64e5bec115c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.311332 Jul 04 05:54:46.230663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 74/127] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:45 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:46.662413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fd68921c-7adb-4773-80d5-4fba3f8add34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:46.662413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fd68921c-7adb-4773-80d5-4fba3f8add34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:46.662702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd68921c-7adb-4773-80d5-4fba3f8add34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:46.663160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd68921c-7adb-4773-80d5-4fba3f8add34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:46.663966 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd68921c-7adb-4773-80d5-4fba3f8add34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:46.664403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd68921c-7adb-4773-80d5-4fba3f8add34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:46.683719 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:46.786740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-66b8e1c2-3e56-4fb8-92aa-a9f72e52f17c req-a3cf2ca7-03ed-44a9-9ff9-ba212c183791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178121f0-a865-467e-a46a-069b621b6d17", "name": "network-vif-plugged", "status": "completed", "tag": "27020a65-ee8e-4790-a27b-3983dfc85818"}, {"server_uuid": "91a604de-7fc4-4f6c-9fce-acd174439f47", "name": "network-vif-plugged", "status": "completed", "tag": "e8ce7b84-57c9-44e0-97c0-aac43b68abec"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:46.796782 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-66b8e1c2-3e56-4fb8-92aa-a9f72e52f17c req-a3cf2ca7-03ed-44a9-9ff9-ba212c183791 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:46.797404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-66b8e1c2-3e56-4fb8-92aa-a9f72e52f17c req-a3cf2ca7-03ed-44a9-9ff9-ba212c183791 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:46.814951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-66b8e1c2-3e56-4fb8-92aa-a9f72e52f17c req-a3cf2ca7-03ed-44a9-9ff9-ba212c183791 service nova] Creating event network-vif-plugged:27020a65-ee8e-4790-a27b-3983dfc85818 for instance 178121f0-a865-467e-a46a-069b621b6d17 on hv-cinder-79733 Jul 04 05:54:46.816400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-66b8e1c2-3e56-4fb8-92aa-a9f72e52f17c req-a3cf2ca7-03ed-44a9-9ff9-ba212c183791 service nova] Creating event network-vif-plugged:e8ce7b84-57c9-44e0-97c0-aac43b68abec for instance 91a604de-7fc4-4f6c-9fce-acd174439f47 on hv-cinder-79733 Jul 04 05:54:46.824985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-66b8e1c2-3e56-4fb8-92aa-a9f72e52f17c req-a3cf2ca7-03ed-44a9-9ff9-ba212c183791 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042926 Jul 04 05:54:46.830467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 75/128] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 04 05:54:46.838935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fd68921c-7adb-4773-80d5-4fba3f8add34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:46.847080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fd68921c-7adb-4773-80d5-4fba3f8add34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.195939 Jul 04 05:54:46.847992 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 54/129] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:46 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:46.934637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-56bbb8e4-3f61-4819-85c9-cec60083e1a2 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:46.935542 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-56bbb8e4-3f61-4819-85c9-cec60083e1a2 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:46.942234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-56bbb8e4-3f61-4819-85c9-cec60083e1a2 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:46.942679 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-56bbb8e4-3f61-4819-85c9-cec60083e1a2 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:46.943817 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-56bbb8e4-3f61-4819-85c9-cec60083e1a2 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:46.944386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-56bbb8e4-3f61-4819-85c9-cec60083e1a2 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:47.073708 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db927a4d-0c80-44c8-b509-2ac067c10164 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:47.074401 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db927a4d-0c80-44c8-b509-2ac067c10164 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:47.078477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-56bbb8e4-3f61-4819-85c9-cec60083e1a2 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:47.080528 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db927a4d-0c80-44c8-b509-2ac067c10164 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:47.081056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db927a4d-0c80-44c8-b509-2ac067c10164 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:47.081923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db927a4d-0c80-44c8-b509-2ac067c10164 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:47.082428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db927a4d-0c80-44c8-b509-2ac067c10164 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:47.086064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-56bbb8e4-3f61-4819-85c9-cec60083e1a2 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.155777 Jul 04 05:54:47.086668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 76/130] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:46 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:47.206433 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db927a4d-0c80-44c8-b509-2ac067c10164 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:47.214548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db927a4d-0c80-44c8-b509-2ac067c10164 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:47.216084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db927a4d-0c80-44c8-b509-2ac067c10164 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:47.217238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db927a4d-0c80-44c8-b509-2ac067c10164 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.148089 Jul 04 05:54:47.217804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 55/131] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:47 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:47.249931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-83fdc656-0d9d-42bb-a43f-dc3cccd44dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:47.250584 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-83fdc656-0d9d-42bb-a43f-dc3cccd44dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:47.259862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83fdc656-0d9d-42bb-a43f-dc3cccd44dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:47.260471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83fdc656-0d9d-42bb-a43f-dc3cccd44dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:47.261647 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83fdc656-0d9d-42bb-a43f-dc3cccd44dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:47.262338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83fdc656-0d9d-42bb-a43f-dc3cccd44dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:47.401991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-83fdc656-0d9d-42bb-a43f-dc3cccd44dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:47.410689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-83fdc656-0d9d-42bb-a43f-dc3cccd44dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.167105 Jul 04 05:54:47.411278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 77/132] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:47 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:47.864089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d2f4b6a-73ca-4662-8431-f31826794739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:47.864692 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d2f4b6a-73ca-4662-8431-f31826794739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:47.871075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d2f4b6a-73ca-4662-8431-f31826794739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:47.871530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d2f4b6a-73ca-4662-8431-f31826794739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:47.872335 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d2f4b6a-73ca-4662-8431-f31826794739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:47.872765 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d2f4b6a-73ca-4662-8431-f31826794739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:48.012954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1d2f4b6a-73ca-4662-8431-f31826794739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:48.020653 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1d2f4b6a-73ca-4662-8431-f31826794739 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.160451 Jul 04 05:54:48.021226 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 56/133] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:47 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:48.101929 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1d86283c-2f9e-4d01-a60f-98e7f154c785 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:48.102697 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1d86283c-2f9e-4d01-a60f-98e7f154c785 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:48.109567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d86283c-2f9e-4d01-a60f-98e7f154c785 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:48.110017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d86283c-2f9e-4d01-a60f-98e7f154c785 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:48.110772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d86283c-2f9e-4d01-a60f-98e7f154c785 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:48.111188 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d86283c-2f9e-4d01-a60f-98e7f154c785 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:48.241609 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ddccd4ad-ff96-4c24-808d-9074a82b1f02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:48.242841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ddccd4ad-ff96-4c24-808d-9074a82b1f02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:48.249355 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddccd4ad-ff96-4c24-808d-9074a82b1f02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:48.249805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddccd4ad-ff96-4c24-808d-9074a82b1f02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:48.250579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddccd4ad-ff96-4c24-808d-9074a82b1f02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:48.251013 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddccd4ad-ff96-4c24-808d-9074a82b1f02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:48.259840 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1d86283c-2f9e-4d01-a60f-98e7f154c785 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:48.267206 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1d86283c-2f9e-4d01-a60f-98e7f154c785 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.169166 Jul 04 05:54:48.267799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 78/134] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:48 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:48.384390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ddccd4ad-ff96-4c24-808d-9074a82b1f02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:48.393974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ddccd4ad-ff96-4c24-808d-9074a82b1f02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:48.395507 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ddccd4ad-ff96-4c24-808d-9074a82b1f02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:48.396611 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ddccd4ad-ff96-4c24-808d-9074a82b1f02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.159727 Jul 04 05:54:48.397174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 57/135] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:48 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:54:48.428152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-980c5c48-16cf-4139-9fb3-5daf3248b02b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:48.428764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-980c5c48-16cf-4139-9fb3-5daf3248b02b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:48.435027 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-980c5c48-16cf-4139-9fb3-5daf3248b02b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:48.435531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-980c5c48-16cf-4139-9fb3-5daf3248b02b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:48.436293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-980c5c48-16cf-4139-9fb3-5daf3248b02b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:48.436724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-980c5c48-16cf-4139-9fb3-5daf3248b02b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:48.573825 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-980c5c48-16cf-4139-9fb3-5daf3248b02b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:48.582331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-980c5c48-16cf-4139-9fb3-5daf3248b02b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.158035 Jul 04 05:54:48.583274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 79/136] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:48 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:49.041822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-67013c71-c946-47ab-bc56-1b829b6a9cda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:49.042741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-67013c71-c946-47ab-bc56-1b829b6a9cda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:49.051766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67013c71-c946-47ab-bc56-1b829b6a9cda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:49.052391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67013c71-c946-47ab-bc56-1b829b6a9cda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:49.053531 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67013c71-c946-47ab-bc56-1b829b6a9cda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:49.054103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67013c71-c946-47ab-bc56-1b829b6a9cda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:49.202452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-67013c71-c946-47ab-bc56-1b829b6a9cda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:49.212060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-67013c71-c946-47ab-bc56-1b829b6a9cda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.176566 Jul 04 05:54:49.213479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 58/137] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:49 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:49.283766 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-850a1d9d-c087-4064-8e39-7fc3d032e0c3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:49.285038 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-850a1d9d-c087-4064-8e39-7fc3d032e0c3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:49.292990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-850a1d9d-c087-4064-8e39-7fc3d032e0c3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:49.293452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-850a1d9d-c087-4064-8e39-7fc3d032e0c3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:49.294230 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-850a1d9d-c087-4064-8e39-7fc3d032e0c3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:49.294654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-850a1d9d-c087-4064-8e39-7fc3d032e0c3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:49.416670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1fc955ff-fb94-4b50-aba4-51323d5fdad6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:49.417843 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1fc955ff-fb94-4b50-aba4-51323d5fdad6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:49.430635 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fc955ff-fb94-4b50-aba4-51323d5fdad6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:49.431090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fc955ff-fb94-4b50-aba4-51323d5fdad6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:49.431959 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fc955ff-fb94-4b50-aba4-51323d5fdad6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:49.432379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fc955ff-fb94-4b50-aba4-51323d5fdad6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:49.443052 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-850a1d9d-c087-4064-8e39-7fc3d032e0c3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:49.451010 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-850a1d9d-c087-4064-8e39-7fc3d032e0c3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.171112 Jul 04 05:54:49.451726 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 80/138] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:49 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:49.576933 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1fc955ff-fb94-4b50-aba4-51323d5fdad6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:49.588078 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1fc955ff-fb94-4b50-aba4-51323d5fdad6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:49.589544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1fc955ff-fb94-4b50-aba4-51323d5fdad6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:49.590855 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1fc955ff-fb94-4b50-aba4-51323d5fdad6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.179457 Jul 04 05:54:49.591899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 59/139] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:49 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:49.604327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9f5ca560-3e7e-4480-b2d4-3d7495fa491b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:49.605632 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9f5ca560-3e7e-4480-b2d4-3d7495fa491b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:49.612222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f5ca560-3e7e-4480-b2d4-3d7495fa491b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:49.612594 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f5ca560-3e7e-4480-b2d4-3d7495fa491b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:49.613419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f5ca560-3e7e-4480-b2d4-3d7495fa491b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:49.614021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f5ca560-3e7e-4480-b2d4-3d7495fa491b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:49.822435 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9f5ca560-3e7e-4480-b2d4-3d7495fa491b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:49.829899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9f5ca560-3e7e-4480-b2d4-3d7495fa491b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.229411 Jul 04 05:54:49.830470 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 81/140] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:49 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:50.239316 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-134561f0-2241-40d4-bbcb-e18d4c228757 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:50.239929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-134561f0-2241-40d4-bbcb-e18d4c228757 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:50.246125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-134561f0-2241-40d4-bbcb-e18d4c228757 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:50.246572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-134561f0-2241-40d4-bbcb-e18d4c228757 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:50.247396 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-134561f0-2241-40d4-bbcb-e18d4c228757 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:50.247891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-134561f0-2241-40d4-bbcb-e18d4c228757 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:50.396098 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-134561f0-2241-40d4-bbcb-e18d4c228757 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:50.404402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-134561f0-2241-40d4-bbcb-e18d4c228757 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.169009 Jul 04 05:54:50.405288 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 60/141] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:50 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:50.468453 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b182b461-5d13-4c69-8d2c-c7564df717a8 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:50.469091 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b182b461-5d13-4c69-8d2c-c7564df717a8 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:50.475446 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b182b461-5d13-4c69-8d2c-c7564df717a8 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:50.475892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b182b461-5d13-4c69-8d2c-c7564df717a8 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:50.476644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b182b461-5d13-4c69-8d2c-c7564df717a8 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:50.477065 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b182b461-5d13-4c69-8d2c-c7564df717a8 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:50.610740 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0027985e-110d-4155-be2d-d50b6845d9c6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:50.612676 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0027985e-110d-4155-be2d-d50b6845d9c6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:50.619741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0027985e-110d-4155-be2d-d50b6845d9c6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:50.620457 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0027985e-110d-4155-be2d-d50b6845d9c6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:50.621431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0027985e-110d-4155-be2d-d50b6845d9c6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:50.622090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0027985e-110d-4155-be2d-d50b6845d9c6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:50.639835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b182b461-5d13-4c69-8d2c-c7564df717a8 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:50.648926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b182b461-5d13-4c69-8d2c-c7564df717a8 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1315 microversion: 2.1 time: 0.184387 Jul 04 05:54:50.649474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 82/142] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:50 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:50.783697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0027985e-110d-4155-be2d-d50b6845d9c6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:50.793450 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0027985e-110d-4155-be2d-d50b6845d9c6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:50.795039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0027985e-110d-4155-be2d-d50b6845d9c6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:50.796178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0027985e-110d-4155-be2d-d50b6845d9c6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1406 microversion: 2.20 time: 0.191373 Jul 04 05:54:50.796714 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 61/143] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:50 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:54:50.846146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-38a4167a-83b4-4e1e-95e8-5fc72d4a0136 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:50.846971 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-38a4167a-83b4-4e1e-95e8-5fc72d4a0136 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:50.853218 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38a4167a-83b4-4e1e-95e8-5fc72d4a0136 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:50.853932 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38a4167a-83b4-4e1e-95e8-5fc72d4a0136 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:50.854699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38a4167a-83b4-4e1e-95e8-5fc72d4a0136 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:50.855362 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38a4167a-83b4-4e1e-95e8-5fc72d4a0136 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:50.972990 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-4c1846ea-4943-4a88-9715-22fbf4146fa0 req-78800971-8248-49a9-99bd-964accb16be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9979d81a-1d93-423a-b99e-74434186140a", "name": "network-vif-plugged", "status": "completed", "tag": "1156d5a0-a197-4c61-8b92-ca56849134a9"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:50.981951 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-4c1846ea-4943-4a88-9715-22fbf4146fa0 req-78800971-8248-49a9-99bd-964accb16be0 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:50.982227 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-4c1846ea-4943-4a88-9715-22fbf4146fa0 req-78800971-8248-49a9-99bd-964accb16be0 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:50.993854 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-4c1846ea-4943-4a88-9715-22fbf4146fa0 req-78800971-8248-49a9-99bd-964accb16be0 service nova] Creating event network-vif-plugged:1156d5a0-a197-4c61-8b92-ca56849134a9 for instance 9979d81a-1d93-423a-b99e-74434186140a on hv-cinder-79733 Jul 04 05:54:50.999043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-4c1846ea-4943-4a88-9715-22fbf4146fa0 req-78800971-8248-49a9-99bd-964accb16be0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029674 Jul 04 05:54:50.999859 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 62/144] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:51.049847 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-38a4167a-83b4-4e1e-95e8-5fc72d4a0136 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:51.059361 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-38a4167a-83b4-4e1e-95e8-5fc72d4a0136 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.217074 Jul 04 05:54:51.060456 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 83/145] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:50 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:51.427228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6cfd09ee-87bb-4bdf-90ac-63215f19b777 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:51.428701 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6cfd09ee-87bb-4bdf-90ac-63215f19b777 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:51.435718 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cfd09ee-87bb-4bdf-90ac-63215f19b777 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:51.436310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cfd09ee-87bb-4bdf-90ac-63215f19b777 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:51.437383 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cfd09ee-87bb-4bdf-90ac-63215f19b777 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:51.437904 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cfd09ee-87bb-4bdf-90ac-63215f19b777 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:51.606228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6cfd09ee-87bb-4bdf-90ac-63215f19b777 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:51.620935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6cfd09ee-87bb-4bdf-90ac-63215f19b777 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.202318 Jul 04 05:54:51.635522 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 63/146] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:51 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:51.666381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0be4c211-6ebe-49fb-8dbb-6b543ee6bad3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:51.667384 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0be4c211-6ebe-49fb-8dbb-6b543ee6bad3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:51.676322 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0be4c211-6ebe-49fb-8dbb-6b543ee6bad3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:51.676729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0be4c211-6ebe-49fb-8dbb-6b543ee6bad3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:51.677550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0be4c211-6ebe-49fb-8dbb-6b543ee6bad3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:51.678007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0be4c211-6ebe-49fb-8dbb-6b543ee6bad3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:51.814798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0e8e98cb-f55c-4ada-a603-143d7525a229 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:51.815681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0e8e98cb-f55c-4ada-a603-143d7525a229 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:51.822023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e8e98cb-f55c-4ada-a603-143d7525a229 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:51.822465 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e8e98cb-f55c-4ada-a603-143d7525a229 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:51.823224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e8e98cb-f55c-4ada-a603-143d7525a229 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:51.823801 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e8e98cb-f55c-4ada-a603-143d7525a229 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:51.854969 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0be4c211-6ebe-49fb-8dbb-6b543ee6bad3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:51.863797 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0be4c211-6ebe-49fb-8dbb-6b543ee6bad3 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1501 microversion: 2.1 time: 0.202272 Jul 04 05:54:51.871365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 84/147] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:51 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1501 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:51.963218 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0e8e98cb-f55c-4ada-a603-143d7525a229 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:51.971958 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0e8e98cb-f55c-4ada-a603-143d7525a229 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:51.973432 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0e8e98cb-f55c-4ada-a603-143d7525a229 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:51.974705 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0e8e98cb-f55c-4ada-a603-143d7525a229 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1598 microversion: 2.20 time: 0.163940 Jul 04 05:54:51.975294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 64/148] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:54:51 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:54:51.993428 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dc1a92a0-56b6-4d46-8783-0de69208f658 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:51.993913 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dc1a92a0-56b6-4d46-8783-0de69208f658 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:52.000323 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc1a92a0-56b6-4d46-8783-0de69208f658 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:52.000830 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc1a92a0-56b6-4d46-8783-0de69208f658 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:52.001597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc1a92a0-56b6-4d46-8783-0de69208f658 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:52.002031 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc1a92a0-56b6-4d46-8783-0de69208f658 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:52.076554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b3cfbb6-edc4-47d7-9849-62011280f98b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:52.077237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4b3cfbb6-edc4-47d7-9849-62011280f98b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:52.086008 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b3cfbb6-edc4-47d7-9849-62011280f98b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:52.086792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b3cfbb6-edc4-47d7-9849-62011280f98b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:52.087868 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b3cfbb6-edc4-47d7-9849-62011280f98b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:52.088450 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b3cfbb6-edc4-47d7-9849-62011280f98b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:52.138777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dc1a92a0-56b6-4d46-8783-0de69208f658 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.149151 Jul 04 05:54:52.146078 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 85/149] 10.222.0.42 () {60 vars in 1315 bytes} [Mon Jul 4 05:54:51 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:54:52.269028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4b3cfbb6-edc4-47d7-9849-62011280f98b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:52.279371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4b3cfbb6-edc4-47d7-9849-62011280f98b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.206062 Jul 04 05:54:52.280168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 65/150] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:52 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:52.637803 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b5803c26-3e2b-4aec-9879-64d56949f4ba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:52.638380 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b5803c26-3e2b-4aec-9879-64d56949f4ba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:52.644893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5803c26-3e2b-4aec-9879-64d56949f4ba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:52.645318 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5803c26-3e2b-4aec-9879-64d56949f4ba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:52.646384 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5803c26-3e2b-4aec-9879-64d56949f4ba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:52.646965 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5803c26-3e2b-4aec-9879-64d56949f4ba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:53.146343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b5803c26-3e2b-4aec-9879-64d56949f4ba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:53.154560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b5803c26-3e2b-4aec-9879-64d56949f4ba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.520659 Jul 04 05:54:53.155352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 86/151] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:52 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:53.297533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-59729314-dd19-4569-9712-551c6fc52fcf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:53.298234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-59729314-dd19-4569-9712-551c6fc52fcf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:53.306760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59729314-dd19-4569-9712-551c6fc52fcf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:53.307163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59729314-dd19-4569-9712-551c6fc52fcf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:53.308279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59729314-dd19-4569-9712-551c6fc52fcf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:53.309638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59729314-dd19-4569-9712-551c6fc52fcf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:53.657557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-a0f6c0fd-4a18-4ed0-b0b8-f55d6d487551 req-799d30cf-60b4-46c8-965c-191e4aaa7150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178121f0-a865-467e-a46a-069b621b6d17", "tag": "27020a65-ee8e-4790-a27b-3983dfc85818"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:53.669552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a0f6c0fd-4a18-4ed0-b0b8-f55d6d487551 req-799d30cf-60b4-46c8-965c-191e4aaa7150 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:53.671286 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a0f6c0fd-4a18-4ed0-b0b8-f55d6d487551 req-799d30cf-60b4-46c8-965c-191e4aaa7150 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:53.686469 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-a0f6c0fd-4a18-4ed0-b0b8-f55d6d487551 req-799d30cf-60b4-46c8-965c-191e4aaa7150 service nova] Creating event network-changed:27020a65-ee8e-4790-a27b-3983dfc85818 for instance 178121f0-a865-467e-a46a-069b621b6d17 on hv-cinder-79733 Jul 04 05:54:53.693912 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-59729314-dd19-4569-9712-551c6fc52fcf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:53.694487 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-a0f6c0fd-4a18-4ed0-b0b8-f55d6d487551 req-799d30cf-60b4-46c8-965c-191e4aaa7150 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042488 Jul 04 05:54:53.695040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 87/152] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:53.704708 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-59729314-dd19-4569-9712-551c6fc52fcf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.410716 Jul 04 05:54:53.705410 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 66/153] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:53 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:54:54.173174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-efbc524d-b74f-47fe-9f9e-9bc46c207ae2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:54.174192 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-efbc524d-b74f-47fe-9f9e-9bc46c207ae2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:54.184825 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efbc524d-b74f-47fe-9f9e-9bc46c207ae2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:54.185624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efbc524d-b74f-47fe-9f9e-9bc46c207ae2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:54.186724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efbc524d-b74f-47fe-9f9e-9bc46c207ae2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:54.187461 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efbc524d-b74f-47fe-9f9e-9bc46c207ae2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:54.347718 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-efbc524d-b74f-47fe-9f9e-9bc46c207ae2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:54.358125 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-efbc524d-b74f-47fe-9f9e-9bc46c207ae2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.189500 Jul 04 05:54:54.359508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 88/154] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:54 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:54.724125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-257fa68b-df4a-4c21-9078-7aa543ce82d4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:54.725642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-257fa68b-df4a-4c21-9078-7aa543ce82d4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:54.733052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-257fa68b-df4a-4c21-9078-7aa543ce82d4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:54.733687 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-257fa68b-df4a-4c21-9078-7aa543ce82d4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:54.734613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-257fa68b-df4a-4c21-9078-7aa543ce82d4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:54.735483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-257fa68b-df4a-4c21-9078-7aa543ce82d4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:54.953862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-257fa68b-df4a-4c21-9078-7aa543ce82d4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:54.962647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-257fa68b-df4a-4c21-9078-7aa543ce82d4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.244150 Jul 04 05:54:54.963238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 67/155] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:54 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:55.377833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-24740d30-7886-4896-bd5e-196e5d227674 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:55.378668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-24740d30-7886-4896-bd5e-196e5d227674 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:55.389264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24740d30-7886-4896-bd5e-196e5d227674 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:55.389809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24740d30-7886-4896-bd5e-196e5d227674 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:55.390807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24740d30-7886-4896-bd5e-196e5d227674 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:55.391461 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24740d30-7886-4896-bd5e-196e5d227674 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:55.396264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-078333cc-b454-4f23-aaee-752dad67af83 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "026cbb26-5939-49e8-825c-ea0f1dff0166"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:55.397605 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-078333cc-b454-4f23-aaee-752dad67af83 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:55.403872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-078333cc-b454-4f23-aaee-752dad67af83 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:55.404493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-078333cc-b454-4f23-aaee-752dad67af83 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:55.406075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-078333cc-b454-4f23-aaee-752dad67af83 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:55.406688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-078333cc-b454-4f23-aaee-752dad67af83 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:55.572105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-24740d30-7886-4896-bd5e-196e5d227674 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:55.588432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-24740d30-7886-4896-bd5e-196e5d227674 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1366 microversion: 2.1 time: 0.216226 Jul 04 05:54:55.597978 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 89/156] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:55 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:55.979721 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-03cdea0b-b413-44de-bf44-9aadf22c8711 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:55.980567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-03cdea0b-b413-44de-bf44-9aadf22c8711 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:55.987233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03cdea0b-b413-44de-bf44-9aadf22c8711 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:55.987861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03cdea0b-b413-44de-bf44-9aadf22c8711 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:55.988952 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03cdea0b-b413-44de-bf44-9aadf22c8711 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:55.989532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03cdea0b-b413-44de-bf44-9aadf22c8711 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:56.205682 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-03cdea0b-b413-44de-bf44-9aadf22c8711 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:56.217117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-03cdea0b-b413-44de-bf44-9aadf22c8711 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.241572 Jul 04 05:54:56.222154 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 90/157] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:55 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:56.317076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-078333cc-b454-4f23-aaee-752dad67af83 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "POST /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.923940 Jul 04 05:54:56.318933 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 68/158] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jul 4 05:54:55 2022] POST /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:56.606886 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c6989089-471e-4e7e-8bd3-9da6fbc1e242 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:56.607845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c6989089-471e-4e7e-8bd3-9da6fbc1e242 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:56.615006 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6989089-471e-4e7e-8bd3-9da6fbc1e242 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:56.615482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6989089-471e-4e7e-8bd3-9da6fbc1e242 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:56.616242 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6989089-471e-4e7e-8bd3-9da6fbc1e242 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:56.616663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6989089-471e-4e7e-8bd3-9da6fbc1e242 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:56.621768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:56.753706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c6989089-471e-4e7e-8bd3-9da6fbc1e242 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:56.761202 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c6989089-471e-4e7e-8bd3-9da6fbc1e242 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1556 microversion: 2.1 time: 0.159534 Jul 04 05:54:56.761972 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 91/159] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:56 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:56.779697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-12894e7e-6d83-4229-93a4-355224ebaa47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:56.780461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-12894e7e-6d83-4229-93a4-355224ebaa47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:56.787501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12894e7e-6d83-4229-93a4-355224ebaa47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:56.788073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12894e7e-6d83-4229-93a4-355224ebaa47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:56.788948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12894e7e-6d83-4229-93a4-355224ebaa47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:56.789592 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12894e7e-6d83-4229-93a4-355224ebaa47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:56.888974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-12894e7e-6d83-4229-93a4-355224ebaa47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113945 Jul 04 05:54:56.889805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 69/160] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jul 4 05:54:56 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:57.239417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fde90462-f331-49ed-960a-12d55f0ff688 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:57.240278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fde90462-f331-49ed-960a-12d55f0ff688 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:57.255187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fde90462-f331-49ed-960a-12d55f0ff688 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:57.255830 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fde90462-f331-49ed-960a-12d55f0ff688 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:57.256724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fde90462-f331-49ed-960a-12d55f0ff688 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:57.257245 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fde90462-f331-49ed-960a-12d55f0ff688 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:57.400335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fde90462-f331-49ed-960a-12d55f0ff688 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:57.411799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fde90462-f331-49ed-960a-12d55f0ff688 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1360 microversion: 2.1 time: 0.176489 Jul 04 05:54:57.412383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 92/161] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:57 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:58.340963 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f864652e-116e-41b3-9f93-56d579ab467d req-3c8473bf-cd12-4225-b516-88278e67114f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a604de-7fc4-4f6c-9fce-acd174439f47", "tag": "e8ce7b84-57c9-44e0-97c0-aac43b68abec"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:54:58.349076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f864652e-116e-41b3-9f93-56d579ab467d req-3c8473bf-cd12-4225-b516-88278e67114f service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:58.349520 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f864652e-116e-41b3-9f93-56d579ab467d req-3c8473bf-cd12-4225-b516-88278e67114f service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:58.360346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f864652e-116e-41b3-9f93-56d579ab467d req-3c8473bf-cd12-4225-b516-88278e67114f service nova] Creating event network-changed:e8ce7b84-57c9-44e0-97c0-aac43b68abec for instance 91a604de-7fc4-4f6c-9fce-acd174439f47 on hv-cinder-79733 Jul 04 05:54:58.365238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f864652e-116e-41b3-9f93-56d579ab467d req-3c8473bf-cd12-4225-b516-88278e67114f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028456 Jul 04 05:54:58.365831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 70/162] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:54:58.429475 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-45dc5902-177c-4617-acd2-e4e4c60ad16b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:58.430115 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-45dc5902-177c-4617-acd2-e4e4c60ad16b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:58.436487 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45dc5902-177c-4617-acd2-e4e4c60ad16b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:58.436989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45dc5902-177c-4617-acd2-e4e4c60ad16b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:58.437774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45dc5902-177c-4617-acd2-e4e4c60ad16b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:58.438213 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45dc5902-177c-4617-acd2-e4e4c60ad16b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:58.568124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-45dc5902-177c-4617-acd2-e4e4c60ad16b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:54:58.576052 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-45dc5902-177c-4617-acd2-e4e4c60ad16b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1546 microversion: 2.1 time: 0.150480 Jul 04 05:54:58.576630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 93/163] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:54:58 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:54:58.594030 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b7d467be-5b0f-4033-bfbe-e725a6600e26 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:54:58.594649 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b7d467be-5b0f-4033-bfbe-e725a6600e26 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:54:58.601361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7d467be-5b0f-4033-bfbe-e725a6600e26 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:58.601813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7d467be-5b0f-4033-bfbe-e725a6600e26 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:58.602580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7d467be-5b0f-4033-bfbe-e725a6600e26 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:54:58.603010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7d467be-5b0f-4033-bfbe-e725a6600e26 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:54:58.619471 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:58.693658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b7d467be-5b0f-4033-bfbe-e725a6600e26 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103926 Jul 04 05:54:58.694744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 71/164] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jul 4 05:54:58 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:55:00.379493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-a0b12d39-ea0f-42e5-868c-0d057ce2958b req-0e05f618-7cae-45a9-be02-da81adbbe9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9979d81a-1d93-423a-b99e-74434186140a", "tag": "1156d5a0-a197-4c61-8b92-ca56849134a9"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:00.388504 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a0b12d39-ea0f-42e5-868c-0d057ce2958b req-0e05f618-7cae-45a9-be02-da81adbbe9fe service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:00.389106 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a0b12d39-ea0f-42e5-868c-0d057ce2958b req-0e05f618-7cae-45a9-be02-da81adbbe9fe service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:00.401596 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-a0b12d39-ea0f-42e5-868c-0d057ce2958b req-0e05f618-7cae-45a9-be02-da81adbbe9fe service nova] Creating event network-changed:1156d5a0-a197-4c61-8b92-ca56849134a9 for instance 9979d81a-1d93-423a-b99e-74434186140a on hv-cinder-79733 Jul 04 05:55:00.407036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-a0b12d39-ea0f-42e5-868c-0d057ce2958b req-0e05f618-7cae-45a9-be02-da81adbbe9fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031133 Jul 04 05:55:00.408005 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 94/165] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:55:15.825273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=69 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:15.829419 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-41c541aa-d821-4d18-b82b-3295312adb89 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:15.830171 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-41c541aa-d821-4d18-b82b-3295312adb89 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:15.837222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41c541aa-d821-4d18-b82b-3295312adb89 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:15.837664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41c541aa-d821-4d18-b82b-3295312adb89 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:15.838483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41c541aa-d821-4d18-b82b-3295312adb89 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:15.838855 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41c541aa-d821-4d18-b82b-3295312adb89 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:15.867001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-41c541aa-d821-4d18-b82b-3295312adb89 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 05:55:15.978861 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-41c541aa-d821-4d18-b82b-3295312adb89 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "DELETE /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 204 len: 0 microversion: 2.1 time: 0.156044 Jul 04 05:55:15.979833 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 72/166] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 05:55:15 2022] DELETE /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 05:55:15.991144 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0b2fa342-cd86-49e1-ab7f-eb1a3bddad0a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:15.992306 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0b2fa342-cd86-49e1-ab7f-eb1a3bddad0a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:15.994629 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=80 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:15.995358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=19 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:16.002660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b2fa342-cd86-49e1-ab7f-eb1a3bddad0a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:16.003347 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b2fa342-cd86-49e1-ab7f-eb1a3bddad0a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:16.004327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b2fa342-cd86-49e1-ab7f-eb1a3bddad0a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:16.004816 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b2fa342-cd86-49e1-ab7f-eb1a3bddad0a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:16.140149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0b2fa342-cd86-49e1-ab7f-eb1a3bddad0a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:16.149074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0b2fa342-cd86-49e1-ab7f-eb1a3bddad0a tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1553 microversion: 2.1 time: 0.162079 Jul 04 05:55:16.149756 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 95/167] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:15 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:17.167108 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a8b1cf89-cd1d-4649-97c6-5cf02236b502 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:17.168012 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a8b1cf89-cd1d-4649-97c6-5cf02236b502 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:17.175729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8b1cf89-cd1d-4649-97c6-5cf02236b502 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:17.176198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8b1cf89-cd1d-4649-97c6-5cf02236b502 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:17.176961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8b1cf89-cd1d-4649-97c6-5cf02236b502 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:17.177397 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8b1cf89-cd1d-4649-97c6-5cf02236b502 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:17.311647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a8b1cf89-cd1d-4649-97c6-5cf02236b502 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:17.320108 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a8b1cf89-cd1d-4649-97c6-5cf02236b502 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1553 microversion: 2.1 time: 0.157436 Jul 04 05:55:17.320652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 73/168] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:17 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:18.337533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f8117d79-03d6-4e76-bd61-1fbf77b81361 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:18.338112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f8117d79-03d6-4e76-bd61-1fbf77b81361 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:18.344601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8117d79-03d6-4e76-bd61-1fbf77b81361 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:18.345043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8117d79-03d6-4e76-bd61-1fbf77b81361 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:18.345800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8117d79-03d6-4e76-bd61-1fbf77b81361 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:18.346422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8117d79-03d6-4e76-bd61-1fbf77b81361 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:18.516088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f8117d79-03d6-4e76-bd61-1fbf77b81361 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:18.526930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f8117d79-03d6-4e76-bd61-1fbf77b81361 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1553 microversion: 2.1 time: 0.193281 Jul 04 05:55:18.527821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 96/169] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:18 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:19.294197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-4d16dc3b-d5b0-4c25-a44a-0adfae49815c req-5be574b1-eaec-4a13-bd64-4bcdf5505549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13375831-faf3-4576-b695-7799f017bf2d", "name": "network-vif-deleted", "tag": "0b8d0fac-ef15-4541-bfda-dfa9f8192c1f"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:19.303877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-4d16dc3b-d5b0-4c25-a44a-0adfae49815c req-5be574b1-eaec-4a13-bd64-4bcdf5505549 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:19.304256 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-4d16dc3b-d5b0-4c25-a44a-0adfae49815c req-5be574b1-eaec-4a13-bd64-4bcdf5505549 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:19.316547 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-4d16dc3b-d5b0-4c25-a44a-0adfae49815c req-5be574b1-eaec-4a13-bd64-4bcdf5505549 service nova] Creating event network-vif-deleted:0b8d0fac-ef15-4541-bfda-dfa9f8192c1f for instance 13375831-faf3-4576-b695-7799f017bf2d on hv-cinder-79733 Jul 04 05:55:19.321987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-4d16dc3b-d5b0-4c25-a44a-0adfae49815c req-5be574b1-eaec-4a13-bd64-4bcdf5505549 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031418 Jul 04 05:55:19.325554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 74/170] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:55:19.546401 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b520464d-a3b4-4182-b1b6-fdd49a2308aa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:19.548489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b520464d-a3b4-4182-b1b6-fdd49a2308aa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:19.558598 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b520464d-a3b4-4182-b1b6-fdd49a2308aa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:19.559227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b520464d-a3b4-4182-b1b6-fdd49a2308aa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:19.562222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b520464d-a3b4-4182-b1b6-fdd49a2308aa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:19.563095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b520464d-a3b4-4182-b1b6-fdd49a2308aa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:19.655101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b520464d-a3b4-4182-b1b6-fdd49a2308aa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e05d19530a74e05a11be774102b425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413717d499504cb29cb26d08bedf7e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:19.665115 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b520464d-a3b4-4182-b1b6-fdd49a2308aa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 200 len: 1346 microversion: 2.1 time: 0.124812 Jul 04 05:55:19.665723 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 97/171] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:19 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 1346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:20.683133 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5b9df1f7-e681-4d11-889a-5c34580b6376 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:20.684228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5b9df1f7-e681-4d11-889a-5c34580b6376 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:20.691961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b9df1f7-e681-4d11-889a-5c34580b6376 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:20.692634 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b9df1f7-e681-4d11-889a-5c34580b6376 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:20.693489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b9df1f7-e681-4d11-889a-5c34580b6376 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:20.693984 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b9df1f7-e681-4d11-889a-5c34580b6376 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:20.709029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-5b9df1f7-e681-4d11-889a-5c34580b6376 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] HTTP exception thrown: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5b9df1f7-e681-4d11-889a-5c34580b6376 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Request method failure captured: Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d HTTP/1.1 Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoB-ksaMy1UkZojt-wwaHeMmW10Q9Az957GJMr35Ipa4XInzcUPc3rFnVolIiYm9OiBJaOJsd4ytrJjpHprEo57HDtSwwYjNTEE1QBtuTndMpBg6U9qDKNuxxPLI6Wc13KwhmqPKdBgvkX2wlvN2kDwKm4WaktN_LmWH6dSoLYoqcJo Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 413717d499504cb29cb26d08bedf7e0a Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 05:55:20.713652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 413717d499504cb29cb26d08bedf7e0a Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-DeleteServersTestJSON-812481878-project Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 3e05d19530a74e05a11be774102b425a Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-DeleteServersTestJSON-812481878-project Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:20.715057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '13375831-faf3-4576-b695-7799f017bf2d'} Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:55:20.716019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:20.717415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:55:20.718515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5b9df1f7-e681-4d11-889a-5c34580b6376 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Returning 404 to user: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:55:20.718515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5b9df1f7-e681-4d11-889a-5c34580b6376 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 404 len: 111 microversion: 2.1 time: 0.036805 Jul 04 05:55:20.718515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 75/172] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:20 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:55:20.833667 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a9d951e5-6de5-427f-af81-268b1fa54bcd tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:20.834595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a9d951e5-6de5-427f-af81-268b1fa54bcd tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:20.841014 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9d951e5-6de5-427f-af81-268b1fa54bcd tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:20.841465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9d951e5-6de5-427f-af81-268b1fa54bcd tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:20.842219 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9d951e5-6de5-427f-af81-268b1fa54bcd tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:20.842646 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9d951e5-6de5-427f-af81-268b1fa54bcd tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:20.855658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-a9d951e5-6de5-427f-af81-268b1fa54bcd tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] HTTP exception thrown: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a9d951e5-6de5-427f-af81-268b1fa54bcd tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Request method failure captured: Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d/os-volume_attachments HTTP/1.1 Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoB-ksaMy1UkZojt-wwaHeMmW10Q9Az957GJMr35Ipa4XInzcUPc3rFnVolIiYm9OiBJaOJsd4ytrJjpHprEo57HDtSwwYjNTEE1QBtuTndMpBg6U9qDKNuxxPLI6Wc13KwhmqPKdBgvkX2wlvN2kDwKm4WaktN_LmWH6dSoLYoqcJo Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 413717d499504cb29cb26d08bedf7e0a Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:55:20.860228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 413717d499504cb29cb26d08bedf7e0a Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-DeleteServersTestJSON-812481878-project Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 3e05d19530a74e05a11be774102b425a Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-DeleteServersTestJSON-812481878-project Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:20.861735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'server_id': '13375831-faf3-4576-b695-7799f017bf2d'} Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:55:20.863519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:20.864976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:55:20.866564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a9d951e5-6de5-427f-af81-268b1fa54bcd tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Returning 404 to user: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:55:20.866564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a9d951e5-6de5-427f-af81-268b1fa54bcd tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032949 Jul 04 05:55:20.866564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 98/173] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 05:55:20 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:55:25.292595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6986007-50e7-4195-9d9f-2249316bf4fa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:25.293085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e6986007-50e7-4195-9d9f-2249316bf4fa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:25.300531 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6986007-50e7-4195-9d9f-2249316bf4fa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:25.301048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6986007-50e7-4195-9d9f-2249316bf4fa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:25.301946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6986007-50e7-4195-9d9f-2249316bf4fa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:25.302458 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6986007-50e7-4195-9d9f-2249316bf4fa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:25.317442 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-e6986007-50e7-4195-9d9f-2249316bf4fa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] HTTP exception thrown: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6986007-50e7-4195-9d9f-2249316bf4fa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Request method failure captured: Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d HTTP/1.1 Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoB-ksaMy1UkZojt-wwaHeMmW10Q9Az957GJMr35Ipa4XInzcUPc3rFnVolIiYm9OiBJaOJsd4ytrJjpHprEo57HDtSwwYjNTEE1QBtuTndMpBg6U9qDKNuxxPLI6Wc13KwhmqPKdBgvkX2wlvN2kDwKm4WaktN_LmWH6dSoLYoqcJo Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 413717d499504cb29cb26d08bedf7e0a Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 05:55:25.318980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 413717d499504cb29cb26d08bedf7e0a Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-DeleteServersTestJSON-812481878-project Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 3e05d19530a74e05a11be774102b425a Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-DeleteServersTestJSON-812481878-project Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:25.320282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '13375831-faf3-4576-b695-7799f017bf2d'} Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:55:25.320927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:25.321991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:55:25.323056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6986007-50e7-4195-9d9f-2249316bf4fa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Returning 404 to user: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:55:25.323056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e6986007-50e7-4195-9d9f-2249316bf4fa tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "DELETE /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 404 len: 111 microversion: 2.1 time: 0.031713 Jul 04 05:55:25.323056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 76/174] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 05:55:25 2022] DELETE /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:55:25.329297 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-72ed4850-9652-45f7-97bc-dc3a21270ef0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:25.329905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-72ed4850-9652-45f7-97bc-dc3a21270ef0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] [instance: 13375831-faf3-4576-b695-7799f017bf2d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:25.336404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72ed4850-9652-45f7-97bc-dc3a21270ef0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:25.336850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72ed4850-9652-45f7-97bc-dc3a21270ef0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:25.337605 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72ed4850-9652-45f7-97bc-dc3a21270ef0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:25.338036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72ed4850-9652-45f7-97bc-dc3a21270ef0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:25.351678 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-72ed4850-9652-45f7-97bc-dc3a21270ef0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] HTTP exception thrown: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-72ed4850-9652-45f7-97bc-dc3a21270ef0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Request method failure captured: Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d HTTP/1.1 Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoB-ksaMy1UkZojt-wwaHeMmW10Q9Az957GJMr35Ipa4XInzcUPc3rFnVolIiYm9OiBJaOJsd4ytrJjpHprEo57HDtSwwYjNTEE1QBtuTndMpBg6U9qDKNuxxPLI6Wc13KwhmqPKdBgvkX2wlvN2kDwKm4WaktN_LmWH6dSoLYoqcJo Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 413717d499504cb29cb26d08bedf7e0a Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:55:25.353762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_413717d499504cb29cb26d08bedf7e0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 413717d499504cb29cb26d08bedf7e0a Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-DeleteServersTestJSON-812481878 Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-DeleteServersTestJSON-812481878-project Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 3e05d19530a74e05a11be774102b425a Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-DeleteServersTestJSON-812481878-project Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:25.355018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '13375831-faf3-4576-b695-7799f017bf2d'} Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:55:25.355694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. Jul 04 05:55:25.356838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:55:25.357901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-72ed4850-9652-45f7-97bc-dc3a21270ef0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] Returning 404 to user: Instance 13375831-faf3-4576-b695-7799f017bf2d could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:55:25.357901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-72ed4850-9652-45f7-97bc-dc3a21270ef0 tempest-DeleteServersTestJSON-812481878 tempest-DeleteServersTestJSON-812481878-project] 10.222.0.42 "GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d" status: 404 len: 111 microversion: 2.1 time: 0.029810 Jul 04 05:55:25.357901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 99/175] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:25 2022] GET /compute/v2.1/servers/13375831-faf3-4576-b695-7799f017bf2d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:55:35.007785 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-27684172", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:35.080770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] validate_networks() for [('a973c6df-b27b-4426-b61c-9570a0a82fe2', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:55:35.308612 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:35.488958 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:55:35.489383 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:55:35.489851 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:55:35.490258 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:55:35.490673 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:55:35.502576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:35.505690 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:35.506664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:35.507110 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:35.525033 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Getting quotas for project 27aa4fc6d2bd46d3a3492cf0b1d7ae9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:55:35.529241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Getting quotas for user 93ae888c6e364e2e96ff52e63415a0e5 and project 27aa4fc6d2bd46d3a3492cf0b1d7ae9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:55:35.540848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:55:35.543179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:55:35.596791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7ab22d7e-72dd-4b45-8640-db81a7f3a30e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.707241 Jul 04 05:55:35.597748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 77/176] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:55:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:55:35.607919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ebf00347-8c02-4761-b548-40e24a231658 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:35.608530 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ebf00347-8c02-4761-b548-40e24a231658 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:35.610775 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=10 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:35.611471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=22 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:35.678578 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ebf00347-8c02-4761-b548-40e24a231658 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:35.686213 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ebf00347-8c02-4761-b548-40e24a231658 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1220 microversion: 2.1 time: 0.082447 Jul 04 05:55:35.686808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 100/177] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:35 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:35.752889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1408713137", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:35.815219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] validate_networks() for [('a973c6df-b27b-4426-b61c-9570a0a82fe2', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:55:36.273829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:55:36.274390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:55:36.274702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:55:36.275336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:55:36.275748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:55:36.284721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:36.285138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:36.286172 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:36.286603 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:36.304985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Getting quotas for project 27aa4fc6d2bd46d3a3492cf0b1d7ae9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:55:36.308728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Getting quotas for user 93ae888c6e364e2e96ff52e63415a0e5 and project 27aa4fc6d2bd46d3a3492cf0b1d7ae9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:55:36.319632 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:55:36.321754 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:55:36.366659 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-95ccc0d3-78d0-4f02-a0c0-1b4b7f101d83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.619386 Jul 04 05:55:36.367319 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 78/178] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:55:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:55:36.377363 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-435c44c4-ca5a-4ef4-a675-6082d0f0ff43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:36.377969 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-435c44c4-ca5a-4ef4-a675-6082d0f0ff43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:36.430557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-435c44c4-ca5a-4ef4-a675-6082d0f0ff43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:36.439471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-435c44c4-ca5a-4ef4-a675-6082d0f0ff43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1222 microversion: 2.1 time: 0.066057 Jul 04 05:55:36.440052 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 101/179] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:36 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:55:37.457234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d0d6101-0169-4919-86d6-b0c691749ec7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:37.458581 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d0d6101-0169-4919-86d6-b0c691749ec7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:37.465845 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d0d6101-0169-4919-86d6-b0c691749ec7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:37.466638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d0d6101-0169-4919-86d6-b0c691749ec7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:37.467683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d0d6101-0169-4919-86d6-b0c691749ec7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:37.468329 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d0d6101-0169-4919-86d6-b0c691749ec7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:37.537314 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1d0d6101-0169-4919-86d6-b0c691749ec7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:37.544905 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1d0d6101-0169-4919-86d6-b0c691749ec7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1274 microversion: 2.1 time: 0.092350 Jul 04 05:55:37.545474 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 79/180] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:37 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:38.568233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4be5ab79-d8f5-4e61-86e3-7a322677e13f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:38.569155 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4be5ab79-d8f5-4e61-86e3-7a322677e13f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:38.578484 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4be5ab79-d8f5-4e61-86e3-7a322677e13f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:38.593908 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4be5ab79-d8f5-4e61-86e3-7a322677e13f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:38.595622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4be5ab79-d8f5-4e61-86e3-7a322677e13f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:38.596315 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4be5ab79-d8f5-4e61-86e3-7a322677e13f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:38.979615 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4be5ab79-d8f5-4e61-86e3-7a322677e13f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:38.988626 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4be5ab79-d8f5-4e61-86e3-7a322677e13f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1280 microversion: 2.1 time: 0.425441 Jul 04 05:55:38.989744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 102/181] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:38 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1280 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:40.006386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6233162c-6584-40b0-b27d-ce18974b3928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:40.007406 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6233162c-6584-40b0-b27d-ce18974b3928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:40.014712 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6233162c-6584-40b0-b27d-ce18974b3928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:40.015746 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6233162c-6584-40b0-b27d-ce18974b3928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:40.016658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6233162c-6584-40b0-b27d-ce18974b3928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:40.017920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6233162c-6584-40b0-b27d-ce18974b3928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:40.212611 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6233162c-6584-40b0-b27d-ce18974b3928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:40.229596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6233162c-6584-40b0-b27d-ce18974b3928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1322 microversion: 2.1 time: 0.227775 Jul 04 05:55:40.230935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 80/182] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:40 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:40.814194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-1f8995b2-756f-4ca8-9ee5-4af0ad47c2e6 req-bdb0ca38-d71c-44ab-954d-7e881239f048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71ad769-1afe-49ae-83d5-07e64f9e4f0c", "tag": "0766d56f-8c07-4df0-b7aa-543c32d5eb3a"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:40.834641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-1f8995b2-756f-4ca8-9ee5-4af0ad47c2e6 req-bdb0ca38-d71c-44ab-954d-7e881239f048 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:40.836397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-1f8995b2-756f-4ca8-9ee5-4af0ad47c2e6 req-bdb0ca38-d71c-44ab-954d-7e881239f048 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:40.862064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-1f8995b2-756f-4ca8-9ee5-4af0ad47c2e6 req-bdb0ca38-d71c-44ab-954d-7e881239f048 service nova] Creating event network-changed:0766d56f-8c07-4df0-b7aa-543c32d5eb3a for instance b71ad769-1afe-49ae-83d5-07e64f9e4f0c on hv-cinder-79733 Jul 04 05:55:40.868079 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-1f8995b2-756f-4ca8-9ee5-4af0ad47c2e6 req-bdb0ca38-d71c-44ab-954d-7e881239f048 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057553 Jul 04 05:55:40.868879 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 103/183] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:55:41.247943 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-659d1ff9-ffa6-4d89-9f07-4a3987d8c67a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:41.248552 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-659d1ff9-ffa6-4d89-9f07-4a3987d8c67a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:41.265821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-659d1ff9-ffa6-4d89-9f07-4a3987d8c67a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:41.266270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-659d1ff9-ffa6-4d89-9f07-4a3987d8c67a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:41.268656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-659d1ff9-ffa6-4d89-9f07-4a3987d8c67a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:41.269038 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-659d1ff9-ffa6-4d89-9f07-4a3987d8c67a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:41.570886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-659d1ff9-ffa6-4d89-9f07-4a3987d8c67a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:41.579660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-659d1ff9-ffa6-4d89-9f07-4a3987d8c67a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1322 microversion: 2.1 time: 0.336669 Jul 04 05:55:41.596628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 81/184] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:41 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:42.604561 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1f148efa-67de-46e3-b875-5fd10d618098 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:42.606166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1f148efa-67de-46e3-b875-5fd10d618098 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:42.613056 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f148efa-67de-46e3-b875-5fd10d618098 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:42.613490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f148efa-67de-46e3-b875-5fd10d618098 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:42.614250 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f148efa-67de-46e3-b875-5fd10d618098 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:42.614672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f148efa-67de-46e3-b875-5fd10d618098 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:42.783648 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f148efa-67de-46e3-b875-5fd10d618098 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:42.791727 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f148efa-67de-46e3-b875-5fd10d618098 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1322 microversion: 2.1 time: 0.191342 Jul 04 05:55:42.792560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 104/185] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:42 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:42.898256 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-846a72a7-e91a-4fe2-a6cb-f12ad1c86ffd req-e708bc92-da38-4ff0-b389-091f42ca344b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b315f101-8d5d-4b0a-994f-f5c7235ddac6", "tag": "192d9e0b-c48b-447f-89e4-584619c09143"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:42.916864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-846a72a7-e91a-4fe2-a6cb-f12ad1c86ffd req-e708bc92-da38-4ff0-b389-091f42ca344b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:42.917644 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-846a72a7-e91a-4fe2-a6cb-f12ad1c86ffd req-e708bc92-da38-4ff0-b389-091f42ca344b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:42.935865 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-846a72a7-e91a-4fe2-a6cb-f12ad1c86ffd req-e708bc92-da38-4ff0-b389-091f42ca344b service nova] Creating event network-changed:192d9e0b-c48b-447f-89e4-584619c09143 for instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 on hv-cinder-79733 Jul 04 05:55:42.941963 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-846a72a7-e91a-4fe2-a6cb-f12ad1c86ffd req-e708bc92-da38-4ff0-b389-091f42ca344b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048465 Jul 04 05:55:42.942571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 82/186] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:55:43.810875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ca1cb129-994d-449d-bc48-c87cdbd646db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:43.815960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ca1cb129-994d-449d-bc48-c87cdbd646db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:43.825373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca1cb129-994d-449d-bc48-c87cdbd646db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:43.826020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca1cb129-994d-449d-bc48-c87cdbd646db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:43.827264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca1cb129-994d-449d-bc48-c87cdbd646db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:43.827693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca1cb129-994d-449d-bc48-c87cdbd646db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:43.989635 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca1cb129-994d-449d-bc48-c87cdbd646db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:43.997749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ca1cb129-994d-449d-bc48-c87cdbd646db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1322 microversion: 2.1 time: 0.191752 Jul 04 05:55:43.999538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 105/187] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:43 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:45.017147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e342835-11ab-4bfc-a7c6-3e0d3840c4ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:45.017928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4e342835-11ab-4bfc-a7c6-3e0d3840c4ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:45.036665 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e342835-11ab-4bfc-a7c6-3e0d3840c4ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:45.037135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e342835-11ab-4bfc-a7c6-3e0d3840c4ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:45.037935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e342835-11ab-4bfc-a7c6-3e0d3840c4ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:45.043506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e342835-11ab-4bfc-a7c6-3e0d3840c4ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:45.257126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4e342835-11ab-4bfc-a7c6-3e0d3840c4ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:45.281700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4e342835-11ab-4bfc-a7c6-3e0d3840c4ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1322 microversion: 2.1 time: 0.262411 Jul 04 05:55:45.282398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 83/188] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:45 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:46.301205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-debba46b-b510-4cf8-bc1f-9f88df199074 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:46.303088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-debba46b-b510-4cf8-bc1f-9f88df199074 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:46.310287 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debba46b-b510-4cf8-bc1f-9f88df199074 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:46.310929 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debba46b-b510-4cf8-bc1f-9f88df199074 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:46.311923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debba46b-b510-4cf8-bc1f-9f88df199074 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:46.312532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debba46b-b510-4cf8-bc1f-9f88df199074 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:46.436893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:46.456819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-debba46b-b510-4cf8-bc1f-9f88df199074 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:46.465451 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-debba46b-b510-4cf8-bc1f-9f88df199074 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1322 microversion: 2.1 time: 0.169409 Jul 04 05:55:46.475274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 106/189] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:46 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:47.326165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-98e7efde-e7df-4fb4-ab4b-558c898c274a req-830d8bde-f74f-4dbc-a429-5767bb9e06fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71ad769-1afe-49ae-83d5-07e64f9e4f0c", "name": "network-vif-plugged", "status": "completed", "tag": "0766d56f-8c07-4df0-b7aa-543c32d5eb3a"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:47.330177 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:47.331413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=12 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:47.332204 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:47.338433 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-98e7efde-e7df-4fb4-ab4b-558c898c274a req-830d8bde-f74f-4dbc-a429-5767bb9e06fc service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:47.339049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-98e7efde-e7df-4fb4-ab4b-558c898c274a req-830d8bde-f74f-4dbc-a429-5767bb9e06fc service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:47.354256 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-98e7efde-e7df-4fb4-ab4b-558c898c274a req-830d8bde-f74f-4dbc-a429-5767bb9e06fc service nova] Creating event network-vif-plugged:0766d56f-8c07-4df0-b7aa-543c32d5eb3a for instance b71ad769-1afe-49ae-83d5-07e64f9e4f0c on hv-cinder-79733 Jul 04 05:55:47.378708 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-98e7efde-e7df-4fb4-ab4b-558c898c274a req-830d8bde-f74f-4dbc-a429-5767bb9e06fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056148 Jul 04 05:55:47.379335 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 84/190] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:55:47.484565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8cde9eb5-5c35-4de5-9d0a-a3657432047d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:47.485220 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8cde9eb5-5c35-4de5-9d0a-a3657432047d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:47.497109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cde9eb5-5c35-4de5-9d0a-a3657432047d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:47.497619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cde9eb5-5c35-4de5-9d0a-a3657432047d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:47.500427 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cde9eb5-5c35-4de5-9d0a-a3657432047d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:47.501129 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cde9eb5-5c35-4de5-9d0a-a3657432047d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:47.769302 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8cde9eb5-5c35-4de5-9d0a-a3657432047d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:47.781510 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8cde9eb5-5c35-4de5-9d0a-a3657432047d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1322 microversion: 2.1 time: 0.303225 Jul 04 05:55:47.782180 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 107/191] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:47 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:48.801633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73e3a265-cb58-4acb-81b3-f271d24d473b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:48.802291 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73e3a265-cb58-4acb-81b3-f271d24d473b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:48.816563 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e3a265-cb58-4acb-81b3-f271d24d473b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:48.817565 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e3a265-cb58-4acb-81b3-f271d24d473b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:48.818364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e3a265-cb58-4acb-81b3-f271d24d473b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:48.818796 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e3a265-cb58-4acb-81b3-f271d24d473b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:48.978717 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73e3a265-cb58-4acb-81b3-f271d24d473b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:48.986700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73e3a265-cb58-4acb-81b3-f271d24d473b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1322 microversion: 2.1 time: 0.192102 Jul 04 05:55:48.987267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 85/192] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:48 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:55:49.396792 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-cc27db03-3749-4dee-abdc-c5269af9c947 req-c1a58673-b857-4de2-a6f6-e75925d46b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b315f101-8d5d-4b0a-994f-f5c7235ddac6", "name": "network-vif-plugged", "status": "completed", "tag": "192d9e0b-c48b-447f-89e4-584619c09143"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:49.405264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-cc27db03-3749-4dee-abdc-c5269af9c947 req-c1a58673-b857-4de2-a6f6-e75925d46b86 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:49.405700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-cc27db03-3749-4dee-abdc-c5269af9c947 req-c1a58673-b857-4de2-a6f6-e75925d46b86 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:49.418171 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-cc27db03-3749-4dee-abdc-c5269af9c947 req-c1a58673-b857-4de2-a6f6-e75925d46b86 service nova] Creating event network-vif-plugged:192d9e0b-c48b-447f-89e4-584619c09143 for instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 on hv-cinder-79733 Jul 04 05:55:49.423551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-cc27db03-3749-4dee-abdc-c5269af9c947 req-c1a58673-b857-4de2-a6f6-e75925d46b86 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030363 Jul 04 05:55:49.424191 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 108/193] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:55:49.822295 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-51118210-95f4-4410-a328-c88d107aeff7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:49.822866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-51118210-95f4-4410-a328-c88d107aeff7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:49.829588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51118210-95f4-4410-a328-c88d107aeff7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:49.830037 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51118210-95f4-4410-a328-c88d107aeff7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:49.830796 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51118210-95f4-4410-a328-c88d107aeff7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:49.831228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51118210-95f4-4410-a328-c88d107aeff7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:49.854269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-51118210-95f4-4410-a328-c88d107aeff7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/ips" status: 200 len: 151 microversion: 2.20 time: 0.035840 Jul 04 05:55:49.854833 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 86/194] 10.222.0.42 () {60 vars in 1288 bytes} [Mon Jul 4 05:55:49 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:55:50.008584 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5670b1c3-36ce-4d3b-8df9-04b8403541ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:50.009579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5670b1c3-36ce-4d3b-8df9-04b8403541ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:50.016386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5670b1c3-36ce-4d3b-8df9-04b8403541ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:50.017011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5670b1c3-36ce-4d3b-8df9-04b8403541ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:50.018000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5670b1c3-36ce-4d3b-8df9-04b8403541ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:50.018442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5670b1c3-36ce-4d3b-8df9-04b8403541ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:50.175607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5670b1c3-36ce-4d3b-8df9-04b8403541ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:50.189834 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5670b1c3-36ce-4d3b-8df9-04b8403541ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1515 microversion: 2.1 time: 0.187146 Jul 04 05:55:50.190429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 109/195] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:49 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:50.206886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6f00515d-a8ee-4868-96c5-89d4f381452f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:50.208147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6f00515d-a8ee-4868-96c5-89d4f381452f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:50.215608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f00515d-a8ee-4868-96c5-89d4f381452f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:50.216049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f00515d-a8ee-4868-96c5-89d4f381452f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:50.217026 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f00515d-a8ee-4868-96c5-89d4f381452f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:50.217520 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f00515d-a8ee-4868-96c5-89d4f381452f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:50.247297 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-6f00515d-a8ee-4868-96c5-89d4f381452f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lazy-loading 'flavor' on Instance uuid b71ad769-1afe-49ae-83d5-07e64f9e4f0c {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:55:50.359644 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6f00515d-a8ee-4868-96c5-89d4f381452f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c/action" status: 200 len: 32 microversion: 2.1 time: 0.157331 Jul 04 05:55:50.360309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 87/196] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 05:55:50 2022] POST /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 05:55:50.369267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d6943ffa-52f4-41cb-9e99-0524a994a68c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:50.369877 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d6943ffa-52f4-41cb-9e99-0524a994a68c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:50.376023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6943ffa-52f4-41cb-9e99-0524a994a68c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:50.376471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6943ffa-52f4-41cb-9e99-0524a994a68c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:50.377262 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6943ffa-52f4-41cb-9e99-0524a994a68c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:50.377665 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6943ffa-52f4-41cb-9e99-0524a994a68c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:50.525720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d6943ffa-52f4-41cb-9e99-0524a994a68c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:50.534294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d6943ffa-52f4-41cb-9e99-0524a994a68c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.168742 Jul 04 05:55:50.535172 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 110/197] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:50 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:51.554246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a29388e7-7bad-4b6b-979e-9a331ef9a857 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:51.554939 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a29388e7-7bad-4b6b-979e-9a331ef9a857 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:51.561427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a29388e7-7bad-4b6b-979e-9a331ef9a857 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:51.561872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a29388e7-7bad-4b6b-979e-9a331ef9a857 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:51.562642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a29388e7-7bad-4b6b-979e-9a331ef9a857 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:51.563094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a29388e7-7bad-4b6b-979e-9a331ef9a857 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:51.716804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a29388e7-7bad-4b6b-979e-9a331ef9a857 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:51.728888 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a29388e7-7bad-4b6b-979e-9a331ef9a857 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.179270 Jul 04 05:55:51.729644 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 88/198] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:51 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:55:52.737158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-542aa75e-a4c0-4b22-8ad8-141d40fc7dcd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:52.737730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-542aa75e-a4c0-4b22-8ad8-141d40fc7dcd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:52.743913 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-542aa75e-a4c0-4b22-8ad8-141d40fc7dcd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:52.744361 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-542aa75e-a4c0-4b22-8ad8-141d40fc7dcd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:52.745225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-542aa75e-a4c0-4b22-8ad8-141d40fc7dcd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:52.745658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-542aa75e-a4c0-4b22-8ad8-141d40fc7dcd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:52.750568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d34546d1-a90a-4750-a2e8-5ff7243cb76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:52.751192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d34546d1-a90a-4750-a2e8-5ff7243cb76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:52.757910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d34546d1-a90a-4750-a2e8-5ff7243cb76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:52.758473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d34546d1-a90a-4750-a2e8-5ff7243cb76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:52.759254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d34546d1-a90a-4750-a2e8-5ff7243cb76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:52.760328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d34546d1-a90a-4750-a2e8-5ff7243cb76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:52.769057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-542aa75e-a4c0-4b22-8ad8-141d40fc7dcd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lazy-loading 'flavor' on Instance uuid 178121f0-a865-467e-a46a-069b621b6d17 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:55:52.899831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d34546d1-a90a-4750-a2e8-5ff7243cb76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:52.910533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d34546d1-a90a-4750-a2e8-5ff7243cb76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.164516 Jul 04 05:55:52.911093 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 89/199] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:52 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:53.126344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-542aa75e-a4c0-4b22-8ad8-141d40fc7dcd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "POST /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/action" status: 202 len: 0 microversion: 2.20 time: 0.392953 Jul 04 05:55:53.126979 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 111/200] 10.222.0.42 () {62 vars in 1318 bytes} [Mon Jul 4 05:55:52 2022] POST /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 05:55:53.136168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8c08604b-f1fa-4103-bbfe-4124d3b90723 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:53.136863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8c08604b-f1fa-4103-bbfe-4124d3b90723 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:53.143684 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c08604b-f1fa-4103-bbfe-4124d3b90723 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:53.144243 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c08604b-f1fa-4103-bbfe-4124d3b90723 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:53.144990 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c08604b-f1fa-4103-bbfe-4124d3b90723 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:53.145529 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c08604b-f1fa-4103-bbfe-4124d3b90723 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:53.279063 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8c08604b-f1fa-4103-bbfe-4124d3b90723 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:53.287382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8c08604b-f1fa-4103-bbfe-4124d3b90723 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:53.288887 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8c08604b-f1fa-4103-bbfe-4124d3b90723 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:53.290048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8c08604b-f1fa-4103-bbfe-4124d3b90723 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.158238 Jul 04 05:55:53.290617 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 90/201] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:55:53 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:55:53.928741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a84a9041-e32f-40ee-a477-11f6dcdb04ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:53.929463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a84a9041-e32f-40ee-a477-11f6dcdb04ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:53.936242 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a84a9041-e32f-40ee-a477-11f6dcdb04ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:53.936682 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a84a9041-e32f-40ee-a477-11f6dcdb04ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:53.937457 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a84a9041-e32f-40ee-a477-11f6dcdb04ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:53.937886 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a84a9041-e32f-40ee-a477-11f6dcdb04ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:54.031519 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f9652433-b2ad-4f4d-9d87-6a88e292fc32 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:54.032062 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f9652433-b2ad-4f4d-9d87-6a88e292fc32 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:54.039946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9652433-b2ad-4f4d-9d87-6a88e292fc32 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:54.040402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9652433-b2ad-4f4d-9d87-6a88e292fc32 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:54.041201 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9652433-b2ad-4f4d-9d87-6a88e292fc32 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:54.041635 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9652433-b2ad-4f4d-9d87-6a88e292fc32 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:54.073658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f9652433-b2ad-4f4d-9d87-6a88e292fc32 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/ips" status: 200 len: 149 microversion: 2.1 time: 0.047227 Jul 04 05:55:54.074519 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 91/202] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jul 4 05:55:54 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:55:54.142433 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a84a9041-e32f-40ee-a477-11f6dcdb04ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:54.151696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a84a9041-e32f-40ee-a477-11f6dcdb04ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.227344 Jul 04 05:55:54.153702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 112/203] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:53 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:54.309273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31fec1ce-77aa-4358-af6c-9a584da25aab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:54.309967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31fec1ce-77aa-4358-af6c-9a584da25aab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:54.318132 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31fec1ce-77aa-4358-af6c-9a584da25aab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:54.318597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31fec1ce-77aa-4358-af6c-9a584da25aab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:54.320143 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31fec1ce-77aa-4358-af6c-9a584da25aab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:54.320748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31fec1ce-77aa-4358-af6c-9a584da25aab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:54.468196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31fec1ce-77aa-4358-af6c-9a584da25aab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:54.476560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31fec1ce-77aa-4358-af6c-9a584da25aab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:54.478073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31fec1ce-77aa-4358-af6c-9a584da25aab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:54.479302 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-31fec1ce-77aa-4358-af6c-9a584da25aab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.174462 Jul 04 05:55:54.479953 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 92/204] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:55:54 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:55:55.169347 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-16596a0f-81b1-4772-8a61-5c76ef27e82e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:55.169948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-16596a0f-81b1-4772-8a61-5c76ef27e82e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:55.176494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16596a0f-81b1-4772-8a61-5c76ef27e82e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:55.178859 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16596a0f-81b1-4772-8a61-5c76ef27e82e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:55.179723 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16596a0f-81b1-4772-8a61-5c76ef27e82e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:55.180153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16596a0f-81b1-4772-8a61-5c76ef27e82e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:55.328309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-16596a0f-81b1-4772-8a61-5c76ef27e82e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:55.337458 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-16596a0f-81b1-4772-8a61-5c76ef27e82e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.171851 Jul 04 05:55:55.338087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 113/205] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:55 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:55.458418 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c8c82bdb-606c-4fe0-b260-2fe91fe74f47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c29cf0e5-0c6c-4806-8032-3951d042d3d3"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:55.459503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c8c82bdb-606c-4fe0-b260-2fe91fe74f47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:55.466068 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8c82bdb-606c-4fe0-b260-2fe91fe74f47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:55.466517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8c82bdb-606c-4fe0-b260-2fe91fe74f47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:55.467382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8c82bdb-606c-4fe0-b260-2fe91fe74f47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:55.467815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8c82bdb-606c-4fe0-b260-2fe91fe74f47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:55.499699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-680b0439-bdd3-434a-b00b-3c906e6f5ac6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:55.500610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-680b0439-bdd3-434a-b00b-3c906e6f5ac6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:55.508030 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-680b0439-bdd3-434a-b00b-3c906e6f5ac6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:55.508560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-680b0439-bdd3-434a-b00b-3c906e6f5ac6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:55.509443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-680b0439-bdd3-434a-b00b-3c906e6f5ac6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:55.509914 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-680b0439-bdd3-434a-b00b-3c906e6f5ac6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:55.704946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-680b0439-bdd3-434a-b00b-3c906e6f5ac6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:55.719054 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-680b0439-bdd3-434a-b00b-3c906e6f5ac6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:55.721312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-680b0439-bdd3-434a-b00b-3c906e6f5ac6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:55.722607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-680b0439-bdd3-434a-b00b-3c906e6f5ac6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.227148 Jul 04 05:55:55.723510 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 114/206] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:55:55 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:55:55.765817 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:55.786067 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c8c82bdb-606c-4fe0-b260-2fe91fe74f47 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "POST /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331413 Jul 04 05:55:55.786790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 93/207] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jul 4 05:55:55 2022] POST /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:55:56.356639 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2292bdc4-c1c6-4349-a96a-d1640c30f116 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:56.357586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2292bdc4-c1c6-4349-a96a-d1640c30f116 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:56.365496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2292bdc4-c1c6-4349-a96a-d1640c30f116 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:56.366210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2292bdc4-c1c6-4349-a96a-d1640c30f116 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:56.367099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2292bdc4-c1c6-4349-a96a-d1640c30f116 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:56.367656 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2292bdc4-c1c6-4349-a96a-d1640c30f116 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:56.507857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2292bdc4-c1c6-4349-a96a-d1640c30f116 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:56.516594 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2292bdc4-c1c6-4349-a96a-d1640c30f116 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.164914 Jul 04 05:55:56.517192 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 115/208] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:56 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:56.741392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-94495935-69f1-4206-91c6-a56cae3321e9 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:56.742087 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-94495935-69f1-4206-91c6-a56cae3321e9 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:56.748957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94495935-69f1-4206-91c6-a56cae3321e9 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:56.749401 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94495935-69f1-4206-91c6-a56cae3321e9 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:56.750165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94495935-69f1-4206-91c6-a56cae3321e9 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:56.750597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94495935-69f1-4206-91c6-a56cae3321e9 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:56.916908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-94495935-69f1-4206-91c6-a56cae3321e9 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:56.925207 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-94495935-69f1-4206-91c6-a56cae3321e9 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:56.926690 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-94495935-69f1-4206-91c6-a56cae3321e9 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:56.927961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-94495935-69f1-4206-91c6-a56cae3321e9 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.191592 Jul 04 05:55:56.928526 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 94/209] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:55:56 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:55:57.533921 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9f1996e2-ec88-495b-9eb9-7b867f37a7b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:57.534524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9f1996e2-ec88-495b-9eb9-7b867f37a7b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:57.540677 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f1996e2-ec88-495b-9eb9-7b867f37a7b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:57.541178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f1996e2-ec88-495b-9eb9-7b867f37a7b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:57.541856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f1996e2-ec88-495b-9eb9-7b867f37a7b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:57.542272 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f1996e2-ec88-495b-9eb9-7b867f37a7b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:57.723729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9f1996e2-ec88-495b-9eb9-7b867f37a7b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:57.735969 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9f1996e2-ec88-495b-9eb9-7b867f37a7b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.204035 Jul 04 05:55:57.735969 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 116/210] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:57 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:57.953429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b0571ca-f1bf-43df-ac5b-8ffd4a7eaaa2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:57.954039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b0571ca-f1bf-43df-ac5b-8ffd4a7eaaa2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:57.961351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b0571ca-f1bf-43df-ac5b-8ffd4a7eaaa2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:57.961959 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b0571ca-f1bf-43df-ac5b-8ffd4a7eaaa2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:57.963399 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b0571ca-f1bf-43df-ac5b-8ffd4a7eaaa2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:57.964167 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b0571ca-f1bf-43df-ac5b-8ffd4a7eaaa2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:58.121896 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b0571ca-f1bf-43df-ac5b-8ffd4a7eaaa2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:58.130514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b0571ca-f1bf-43df-ac5b-8ffd4a7eaaa2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:58.132052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b0571ca-f1bf-43df-ac5b-8ffd4a7eaaa2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:58.133231 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b0571ca-f1bf-43df-ac5b-8ffd4a7eaaa2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.185787 Jul 04 05:55:58.134139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 95/211] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:55:57 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:55:58.754329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9991125f-cd32-4a90-a9f9-66dc6eb411ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:58.755329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9991125f-cd32-4a90-a9f9-66dc6eb411ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:58.766285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9991125f-cd32-4a90-a9f9-66dc6eb411ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:58.766660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9991125f-cd32-4a90-a9f9-66dc6eb411ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:58.767350 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9991125f-cd32-4a90-a9f9-66dc6eb411ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:58.767776 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9991125f-cd32-4a90-a9f9-66dc6eb411ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:58.901288 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9991125f-cd32-4a90-a9f9-66dc6eb411ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:58.905193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:58.912332 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9991125f-cd32-4a90-a9f9-66dc6eb411ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.164432 Jul 04 05:55:58.912956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 117/212] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:58 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:55:59.151933 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f6529a54-079a-4e13-8cef-881296e24502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:59.152581 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f6529a54-079a-4e13-8cef-881296e24502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:59.175478 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6529a54-079a-4e13-8cef-881296e24502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:59.175935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6529a54-079a-4e13-8cef-881296e24502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:59.176731 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6529a54-079a-4e13-8cef-881296e24502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:59.177148 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6529a54-079a-4e13-8cef-881296e24502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:59.324900 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-478432504", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "networks": [{"uuid": "cd7f0d58-90b5-46e5-9f5d-74435b61e1de"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:55:59.371366 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f6529a54-079a-4e13-8cef-881296e24502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:59.379978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f6529a54-079a-4e13-8cef-881296e24502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:59.381355 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f6529a54-079a-4e13-8cef-881296e24502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:59.382520 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f6529a54-079a-4e13-8cef-881296e24502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.234592 Jul 04 05:55:59.383066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 96/213] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:55:59 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:55:59.386166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] validate_networks() for [('cd7f0d58-90b5-46e5-9f5d-74435b61e1de', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:55:59.791664 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:55:59.792244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:55:59.792557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:55:59.792922 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:55:59.793318 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:55:59.803856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:59.804291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:59.805068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:59.805493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:59.824777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Getting quotas for project ee9a610826bc47b395a26f07ad375965. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:55:59.828886 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Getting quotas for user 9dd9a1603e2340eba37ae8699f40b9f6 and project ee9a610826bc47b395a26f07ad375965. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:55:59.839894 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:55:59.842174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:55:59.890262 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9b5031d7-3067-42b0-bfbe-fd94c4b111f4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569053 Jul 04 05:55:59.890924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 118/214] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:55:59.902243 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-71ad431f-9cfb-4b9f-9b9c-fbc113ea5011 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:59.903134 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-71ad431f-9cfb-4b9f-9b9c-fbc113ea5011 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:59.930256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-867ec421-39de-4262-8554-a23c4d5795fb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:55:59.930852 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-867ec421-39de-4262-8554-a23c4d5795fb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:55:59.938126 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-867ec421-39de-4262-8554-a23c4d5795fb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:59.938813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-867ec421-39de-4262-8554-a23c4d5795fb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:59.939773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-867ec421-39de-4262-8554-a23c4d5795fb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:55:59.940195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-867ec421-39de-4262-8554-a23c4d5795fb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:55:59.969079 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-71ad431f-9cfb-4b9f-9b9c-fbc113ea5011 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:55:59.991433 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-71ad431f-9cfb-4b9f-9b9c-fbc113ea5011 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1213 microversion: 2.1 time: 0.092115 Jul 04 05:56:00.002056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 97/215] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:59 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:00.128390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-867ec421-39de-4262-8554-a23c4d5795fb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:00.136244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-867ec421-39de-4262-8554-a23c4d5795fb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.210109 Jul 04 05:56:00.137077 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 119/216] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:55:59 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:00.401563 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a7d8c5b4-8157-4ce6-a6bf-ed822feae007 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:00.402188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a7d8c5b4-8157-4ce6-a6bf-ed822feae007 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:00.410210 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7d8c5b4-8157-4ce6-a6bf-ed822feae007 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:00.410662 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7d8c5b4-8157-4ce6-a6bf-ed822feae007 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:00.411471 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7d8c5b4-8157-4ce6-a6bf-ed822feae007 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:00.411913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7d8c5b4-8157-4ce6-a6bf-ed822feae007 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:00.577556 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a7d8c5b4-8157-4ce6-a6bf-ed822feae007 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:00.587009 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a7d8c5b4-8157-4ce6-a6bf-ed822feae007 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:00.589174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a7d8c5b4-8157-4ce6-a6bf-ed822feae007 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:00.590403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a7d8c5b4-8157-4ce6-a6bf-ed822feae007 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.193503 Jul 04 05:56:00.591014 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 98/217] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:00 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:01.012410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-34f3bb0e-d2e7-479b-b36d-5207d54936b5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:01.013820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-34f3bb0e-d2e7-479b-b36d-5207d54936b5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:01.024090 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34f3bb0e-d2e7-479b-b36d-5207d54936b5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:01.024750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34f3bb0e-d2e7-479b-b36d-5207d54936b5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:01.025772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34f3bb0e-d2e7-479b-b36d-5207d54936b5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:01.026308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34f3bb0e-d2e7-479b-b36d-5207d54936b5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:01.129739 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-34f3bb0e-d2e7-479b-b36d-5207d54936b5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:01.144955 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-34f3bb0e-d2e7-479b-b36d-5207d54936b5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1273 microversion: 2.1 time: 0.136353 Jul 04 05:56:01.145995 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 120/218] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:01 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:01.154145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8b437beb-00a8-4c50-bcc1-2f7a567d1f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:01.154983 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8b437beb-00a8-4c50-bcc1-2f7a567d1f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:01.162270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b437beb-00a8-4c50-bcc1-2f7a567d1f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:01.162962 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b437beb-00a8-4c50-bcc1-2f7a567d1f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:01.163987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b437beb-00a8-4c50-bcc1-2f7a567d1f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:01.164618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b437beb-00a8-4c50-bcc1-2f7a567d1f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:01.308966 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8b437beb-00a8-4c50-bcc1-2f7a567d1f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:01.317259 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8b437beb-00a8-4c50-bcc1-2f7a567d1f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.167142 Jul 04 05:56:01.317829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 99/219] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:01 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:01.610146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-712a0f47-7640-4f3a-b2de-b4a06a2f3751 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:01.610651 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-712a0f47-7640-4f3a-b2de-b4a06a2f3751 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:01.616783 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-712a0f47-7640-4f3a-b2de-b4a06a2f3751 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:01.617263 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-712a0f47-7640-4f3a-b2de-b4a06a2f3751 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:01.618030 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-712a0f47-7640-4f3a-b2de-b4a06a2f3751 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:01.618461 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-712a0f47-7640-4f3a-b2de-b4a06a2f3751 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:01.835097 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-712a0f47-7640-4f3a-b2de-b4a06a2f3751 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:01.843644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-712a0f47-7640-4f3a-b2de-b4a06a2f3751 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:01.845450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-712a0f47-7640-4f3a-b2de-b4a06a2f3751 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:01.846614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-712a0f47-7640-4f3a-b2de-b4a06a2f3751 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.241351 Jul 04 05:56:01.847178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 121/220] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:01 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:02.165178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-67c4e355-9d2a-46a1-b5fc-28db3c3a6faf tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:02.165954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-67c4e355-9d2a-46a1-b5fc-28db3c3a6faf tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:02.174158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67c4e355-9d2a-46a1-b5fc-28db3c3a6faf tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:02.174714 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67c4e355-9d2a-46a1-b5fc-28db3c3a6faf tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:02.175591 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67c4e355-9d2a-46a1-b5fc-28db3c3a6faf tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:02.176035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67c4e355-9d2a-46a1-b5fc-28db3c3a6faf tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:02.315585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-67c4e355-9d2a-46a1-b5fc-28db3c3a6faf tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:02.323645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-67c4e355-9d2a-46a1-b5fc-28db3c3a6faf tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.163192 Jul 04 05:56:02.324223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 100/221] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:02 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:02.334859 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e12ef6cb-06bd-4414-aaf2-18aa1ade0705 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:02.335605 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e12ef6cb-06bd-4414-aaf2-18aa1ade0705 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:02.341713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e12ef6cb-06bd-4414-aaf2-18aa1ade0705 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:02.342338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e12ef6cb-06bd-4414-aaf2-18aa1ade0705 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:02.343282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e12ef6cb-06bd-4414-aaf2-18aa1ade0705 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:02.343711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e12ef6cb-06bd-4414-aaf2-18aa1ade0705 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:02.539820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e12ef6cb-06bd-4414-aaf2-18aa1ade0705 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:02.555833 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f8dec692-89bd-4123-a9c8-8268b459e461 req-e66c9801-9e94-40ab-b8d5-644aad8814d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6a82fd-4ec7-4019-97b0-bda931a3b48d", "tag": "b2717eda-04d8-4f3b-9fe7-7ec276183cc0"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:02.564198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e12ef6cb-06bd-4414-aaf2-18aa1ade0705 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.230115 Jul 04 05:56:02.564969 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 122/222] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:02 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:02.588816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f8dec692-89bd-4123-a9c8-8268b459e461 req-e66c9801-9e94-40ab-b8d5-644aad8814d1 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:02.589508 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f8dec692-89bd-4123-a9c8-8268b459e461 req-e66c9801-9e94-40ab-b8d5-644aad8814d1 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:02.606805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f8dec692-89bd-4123-a9c8-8268b459e461 req-e66c9801-9e94-40ab-b8d5-644aad8814d1 service nova] Creating event network-changed:b2717eda-04d8-4f3b-9fe7-7ec276183cc0 for instance 4f6a82fd-4ec7-4019-97b0-bda931a3b48d on hv-cinder-79733 Jul 04 05:56:02.614212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f8dec692-89bd-4123-a9c8-8268b459e461 req-e66c9801-9e94-40ab-b8d5-644aad8814d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061659 Jul 04 05:56:02.617881 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 101/223] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:56:02.866280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-08a549d0-a717-4bda-9d2b-3a70836e3011 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:02.866885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-08a549d0-a717-4bda-9d2b-3a70836e3011 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:02.873364 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08a549d0-a717-4bda-9d2b-3a70836e3011 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:02.874546 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08a549d0-a717-4bda-9d2b-3a70836e3011 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:02.876349 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08a549d0-a717-4bda-9d2b-3a70836e3011 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:02.876877 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08a549d0-a717-4bda-9d2b-3a70836e3011 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:03.104774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-08a549d0-a717-4bda-9d2b-3a70836e3011 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:03.113070 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-08a549d0-a717-4bda-9d2b-3a70836e3011 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:03.114557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-08a549d0-a717-4bda-9d2b-3a70836e3011 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:03.115780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-08a549d0-a717-4bda-9d2b-3a70836e3011 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.254607 Jul 04 05:56:03.116352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 123/224] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:02 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:03.341082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ebd04975-a7aa-4872-a6c5-88998729786b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:03.341781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ebd04975-a7aa-4872-a6c5-88998729786b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:03.348947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebd04975-a7aa-4872-a6c5-88998729786b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:03.349402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebd04975-a7aa-4872-a6c5-88998729786b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:03.350198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebd04975-a7aa-4872-a6c5-88998729786b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:03.350637 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebd04975-a7aa-4872-a6c5-88998729786b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:03.369611 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-06711e75-1582-4ac1-9ef8-41244a614346 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Action: 'create', calling method: .version_select at 0x7f204c081b80>, body: {"keypair": {"name": "tempest-keypair-510214779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpYR3QDiUDZtrPNR+MJ4Jlf0ehq+FAqAIb9i0q0K3r4F6naJk7pczVxofaiDAhooha3KZ8p+pUbxmV/mBgbBcF29VOtrc4Xm9N5V4SmA+dGt8qCaF2+ywYDTKBb7k7Dmw=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:03.383541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-06711e75-1582-4ac1-9ef8-41244a614346 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for project 4e16375231df4b768b8355e320e91731. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:56:03.387380 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-06711e75-1582-4ac1-9ef8-41244a614346 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for user e367c76dfa7f4d2791e60ce148f352c3 and project 4e16375231df4b768b8355e320e91731. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:56:03.411419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-06711e75-1582-4ac1-9ef8-41244a614346 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045558 Jul 04 05:56:03.412021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 124/225] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jul 4 05:56:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:56:03.486848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ebd04975-a7aa-4872-a6c5-88998729786b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:03.495217 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ebd04975-a7aa-4872-a6c5-88998729786b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.158323 Jul 04 05:56:03.496108 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 102/226] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:03 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:03.581653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-99747521-8d41-4778-860c-10a5db676636 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:03.582281 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-99747521-8d41-4778-860c-10a5db676636 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:03.588712 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99747521-8d41-4778-860c-10a5db676636 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:03.589265 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99747521-8d41-4778-860c-10a5db676636 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:03.590217 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99747521-8d41-4778-860c-10a5db676636 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:03.590844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99747521-8d41-4778-860c-10a5db676636 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:03.741375 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-99747521-8d41-4778-860c-10a5db676636 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:03.752223 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-99747521-8d41-4778-860c-10a5db676636 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.174536 Jul 04 05:56:03.753832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 125/227] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:03 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:04.134101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-108032a2-9a27-4933-a9b4-e109ce35925d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:04.134710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-108032a2-9a27-4933-a9b4-e109ce35925d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:04.141361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-108032a2-9a27-4933-a9b4-e109ce35925d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:04.141914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-108032a2-9a27-4933-a9b4-e109ce35925d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:04.142793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-108032a2-9a27-4933-a9b4-e109ce35925d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:04.143386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-108032a2-9a27-4933-a9b4-e109ce35925d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:04.297597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-108032a2-9a27-4933-a9b4-e109ce35925d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:04.305878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-108032a2-9a27-4933-a9b4-e109ce35925d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:04.307402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-108032a2-9a27-4933-a9b4-e109ce35925d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:04.308625 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-108032a2-9a27-4933-a9b4-e109ce35925d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.178367 Jul 04 05:56:04.309086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 103/228] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:04 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:04.511608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-68eaded9-1795-4734-a89d-2bac8a22077a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:04.512241 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-68eaded9-1795-4734-a89d-2bac8a22077a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:04.518808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68eaded9-1795-4734-a89d-2bac8a22077a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:04.519586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68eaded9-1795-4734-a89d-2bac8a22077a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:04.520363 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68eaded9-1795-4734-a89d-2bac8a22077a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:04.521076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68eaded9-1795-4734-a89d-2bac8a22077a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:04.769549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-09cdda59-de4d-47a3-add7-8e72db4e249b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:04.770912 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-09cdda59-de4d-47a3-add7-8e72db4e249b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:04.779185 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09cdda59-de4d-47a3-add7-8e72db4e249b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:04.779686 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09cdda59-de4d-47a3-add7-8e72db4e249b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:04.780821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09cdda59-de4d-47a3-add7-8e72db4e249b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:04.781276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09cdda59-de4d-47a3-add7-8e72db4e249b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:04.829304 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68eaded9-1795-4734-a89d-2bac8a22077a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:04.841319 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-68eaded9-1795-4734-a89d-2bac8a22077a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.333503 Jul 04 05:56:04.842249 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 126/229] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:04 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:04.954382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-09cdda59-de4d-47a3-add7-8e72db4e249b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:04.963438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-09cdda59-de4d-47a3-add7-8e72db4e249b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.198339 Jul 04 05:56:04.964017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 104/230] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:04 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:05.327774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d0291178-94ff-4013-8dda-fa5f8a2fb9d7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:05.328382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d0291178-94ff-4013-8dda-fa5f8a2fb9d7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:05.341878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0291178-94ff-4013-8dda-fa5f8a2fb9d7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:05.342256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0291178-94ff-4013-8dda-fa5f8a2fb9d7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:05.342994 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0291178-94ff-4013-8dda-fa5f8a2fb9d7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:05.343503 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0291178-94ff-4013-8dda-fa5f8a2fb9d7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:05.674438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d0291178-94ff-4013-8dda-fa5f8a2fb9d7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:05.684386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d0291178-94ff-4013-8dda-fa5f8a2fb9d7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:05.685887 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d0291178-94ff-4013-8dda-fa5f8a2fb9d7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:05.687058 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d0291178-94ff-4013-8dda-fa5f8a2fb9d7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.363214 Jul 04 05:56:05.687875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 127/231] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:05 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:05.774422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-468641698", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cff6865-4d61-43fd-b392-bb40cec9d37d"}], "security_groups": [{"name": "tempest-securitygroup--1460986958"}], "key_name": "tempest-keypair-510214779", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:05.857954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c4f36512-0fc9-4030-90f8-a074904d6342 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:05.858570 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c4f36512-0fc9-4030-90f8-a074904d6342 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:05.860842 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:05.866187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4f36512-0fc9-4030-90f8-a074904d6342 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:05.866622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4f36512-0fc9-4030-90f8-a074904d6342 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:05.867415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4f36512-0fc9-4030-90f8-a074904d6342 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:05.867832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4f36512-0fc9-4030-90f8-a074904d6342 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:05.888192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] validate_networks() for [('9cff6865-4d61-43fd-b392-bb40cec9d37d', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:56:06.000229 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c4f36512-0fc9-4030-90f8-a074904d6342 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:06.008255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c4f36512-0fc9-4030-90f8-a074904d6342 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.154149 Jul 04 05:56:06.008841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 128/232] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:05 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:06.013272 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9cd68ef3-fcc3-410e-88ff-de3906b3b76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:06.013907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9cd68ef3-fcc3-410e-88ff-de3906b3b76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:06.022170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cd68ef3-fcc3-410e-88ff-de3906b3b76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:06.022660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cd68ef3-fcc3-410e-88ff-de3906b3b76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:06.023778 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cd68ef3-fcc3-410e-88ff-de3906b3b76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:06.024341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cd68ef3-fcc3-410e-88ff-de3906b3b76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:06.160446 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9cd68ef3-fcc3-410e-88ff-de3906b3b76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:06.168162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9cd68ef3-fcc3-410e-88ff-de3906b3b76f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.158299 Jul 04 05:56:06.168749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 129/233] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:06 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:06.180479 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-98d8bcdd-9722-4586-a837-b9c5fb425b9c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:06.181109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-98d8bcdd-9722-4586-a837-b9c5fb425b9c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:06.188336 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98d8bcdd-9722-4586-a837-b9c5fb425b9c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:06.189131 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98d8bcdd-9722-4586-a837-b9c5fb425b9c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:06.189906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98d8bcdd-9722-4586-a837-b9c5fb425b9c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:06.190332 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98d8bcdd-9722-4586-a837-b9c5fb425b9c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:06.221289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-98d8bcdd-9722-4586-a837-b9c5fb425b9c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/ips" status: 200 len: 146 microversion: 2.1 time: 0.044755 Jul 04 05:56:06.221868 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 130/234] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jul 4 05:56:06 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:56:06.301364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:56:06.302483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:56:06.303209 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:56:06.304752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:56:06.305353 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:56:06.317872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:06.318652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:06.319660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:06.320738 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:06.339026 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for project 4e16375231df4b768b8355e320e91731. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:56:06.342973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for user e367c76dfa7f4d2791e60ce148f352c3 and project 4e16375231df4b768b8355e320e91731. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:56:06.354292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:56:06.356584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:56:06.407625 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f67481bb-204b-4e3c-8902-89bdaece7058 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.637263 Jul 04 05:56:06.414154 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 105/235] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:56:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:56:06.420125 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e25dec33-859e-40de-a481-5a043e82b5dd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:06.420733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e25dec33-859e-40de-a481-5a043e82b5dd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:06.486355 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e25dec33-859e-40de-a481-5a043e82b5dd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:06.493427 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e25dec33-859e-40de-a481-5a043e82b5dd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1240 microversion: 2.1 time: 0.077625 Jul 04 05:56:06.493991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 131/236] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:06 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:06.715875 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61e6099a-1cb4-421c-b6fe-6d443527e7ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:06.716574 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61e6099a-1cb4-421c-b6fe-6d443527e7ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:06.726505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e6099a-1cb4-421c-b6fe-6d443527e7ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:06.726993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e6099a-1cb4-421c-b6fe-6d443527e7ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:06.727808 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e6099a-1cb4-421c-b6fe-6d443527e7ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:06.728222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e6099a-1cb4-421c-b6fe-6d443527e7ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:06.870681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61e6099a-1cb4-421c-b6fe-6d443527e7ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:06.878692 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61e6099a-1cb4-421c-b6fe-6d443527e7ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:06.880228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61e6099a-1cb4-421c-b6fe-6d443527e7ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:06.881418 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61e6099a-1cb4-421c-b6fe-6d443527e7ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.177503 Jul 04 05:56:06.882033 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 106/237] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:06 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:07.034455 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e8ed37b9-06c1-4261-a581-bbb45bc3d069 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:07.035334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e8ed37b9-06c1-4261-a581-bbb45bc3d069 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:07.045910 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8ed37b9-06c1-4261-a581-bbb45bc3d069 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:07.046653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8ed37b9-06c1-4261-a581-bbb45bc3d069 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:07.048494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8ed37b9-06c1-4261-a581-bbb45bc3d069 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:07.049241 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8ed37b9-06c1-4261-a581-bbb45bc3d069 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:07.185955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8fae4a01-070f-4511-899d-e01c5308efd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:07.186726 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8fae4a01-070f-4511-899d-e01c5308efd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:07.189110 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e8ed37b9-06c1-4261-a581-bbb45bc3d069 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:07.194028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fae4a01-070f-4511-899d-e01c5308efd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:07.194596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fae4a01-070f-4511-899d-e01c5308efd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:07.195490 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fae4a01-070f-4511-899d-e01c5308efd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:07.196654 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fae4a01-070f-4511-899d-e01c5308efd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:07.197217 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e8ed37b9-06c1-4261-a581-bbb45bc3d069 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.168448 Jul 04 05:56:07.197762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 132/238] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:07 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:07.333558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8fae4a01-070f-4511-899d-e01c5308efd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:07.341092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8fae4a01-070f-4511-899d-e01c5308efd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.159192 Jul 04 05:56:07.341649 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 107/239] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:07 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:07.510103 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5d4b6299-4d79-4e45-98c0-52f365e56e16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:07.510711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5d4b6299-4d79-4e45-98c0-52f365e56e16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:07.517316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d4b6299-4d79-4e45-98c0-52f365e56e16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:07.517801 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d4b6299-4d79-4e45-98c0-52f365e56e16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:07.518567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d4b6299-4d79-4e45-98c0-52f365e56e16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:07.518991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d4b6299-4d79-4e45-98c0-52f365e56e16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:07.580592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5d4b6299-4d79-4e45-98c0-52f365e56e16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:07.588524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5d4b6299-4d79-4e45-98c0-52f365e56e16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1244 microversion: 2.1 time: 0.082438 Jul 04 05:56:07.589218 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 133/240] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:07 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:07.902378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e0bf81ca-a5cf-456c-a1f7-94cb60a2e19d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:07.903216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e0bf81ca-a5cf-456c-a1f7-94cb60a2e19d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:07.910347 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0bf81ca-a5cf-456c-a1f7-94cb60a2e19d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:07.910798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0bf81ca-a5cf-456c-a1f7-94cb60a2e19d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:07.911594 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0bf81ca-a5cf-456c-a1f7-94cb60a2e19d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:07.912027 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0bf81ca-a5cf-456c-a1f7-94cb60a2e19d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:08.058646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0bf81ca-a5cf-456c-a1f7-94cb60a2e19d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:08.066904 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0bf81ca-a5cf-456c-a1f7-94cb60a2e19d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:08.068435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0bf81ca-a5cf-456c-a1f7-94cb60a2e19d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:08.069611 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e0bf81ca-a5cf-456c-a1f7-94cb60a2e19d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.172989 Jul 04 05:56:08.070176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 108/241] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:07 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:08.217623 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-16192e53-02bf-4635-8ff0-916c5c35bab5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:08.218480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-16192e53-02bf-4635-8ff0-916c5c35bab5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:08.225869 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16192e53-02bf-4635-8ff0-916c5c35bab5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:08.226310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16192e53-02bf-4635-8ff0-916c5c35bab5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:08.227076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16192e53-02bf-4635-8ff0-916c5c35bab5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:08.227534 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16192e53-02bf-4635-8ff0-916c5c35bab5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:08.358042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b25bdd8e-cde7-43c4-8316-c1395221ce64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:08.358688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b25bdd8e-cde7-43c4-8316-c1395221ce64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:08.365040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b25bdd8e-cde7-43c4-8316-c1395221ce64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:08.365502 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b25bdd8e-cde7-43c4-8316-c1395221ce64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:08.366286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b25bdd8e-cde7-43c4-8316-c1395221ce64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:08.366724 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b25bdd8e-cde7-43c4-8316-c1395221ce64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:08.375674 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-16192e53-02bf-4635-8ff0-916c5c35bab5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:08.384538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-16192e53-02bf-4635-8ff0-916c5c35bab5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.173509 Jul 04 05:56:08.385346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 134/242] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:08 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:08.508902 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b25bdd8e-cde7-43c4-8316-c1395221ce64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:08.522151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b25bdd8e-cde7-43c4-8316-c1395221ce64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.167986 Jul 04 05:56:08.522728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 109/243] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:08 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:08.610392 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a0a8e67-a142-429f-9f45-86e1ed7544de tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:08.611529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a0a8e67-a142-429f-9f45-86e1ed7544de tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:08.618440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a0a8e67-a142-429f-9f45-86e1ed7544de tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:08.618887 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a0a8e67-a142-429f-9f45-86e1ed7544de tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:08.619680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a0a8e67-a142-429f-9f45-86e1ed7544de tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:08.620107 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a0a8e67-a142-429f-9f45-86e1ed7544de tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:08.688880 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8a0a8e67-a142-429f-9f45-86e1ed7544de tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:08.696884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a0a8e67-a142-429f-9f45-86e1ed7544de tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1236 microversion: 2.1 time: 0.092929 Jul 04 05:56:08.697430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 135/244] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:08 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1236 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:09.092299 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61fbe300-9b69-4e76-af3a-5a526a743fe0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:09.093140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61fbe300-9b69-4e76-af3a-5a526a743fe0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:09.101103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61fbe300-9b69-4e76-af3a-5a526a743fe0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:09.101551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61fbe300-9b69-4e76-af3a-5a526a743fe0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:09.102318 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61fbe300-9b69-4e76-af3a-5a526a743fe0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:09.102780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61fbe300-9b69-4e76-af3a-5a526a743fe0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:09.236358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61fbe300-9b69-4e76-af3a-5a526a743fe0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:09.244487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61fbe300-9b69-4e76-af3a-5a526a743fe0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:09.245981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61fbe300-9b69-4e76-af3a-5a526a743fe0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:09.247150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61fbe300-9b69-4e76-af3a-5a526a743fe0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.161720 Jul 04 05:56:09.247774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 110/245] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:09 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:09.401757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2e988e2d-b2f5-4190-8f0c-194974e9622d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:09.402468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2e988e2d-b2f5-4190-8f0c-194974e9622d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:09.408740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e988e2d-b2f5-4190-8f0c-194974e9622d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:09.409180 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e988e2d-b2f5-4190-8f0c-194974e9622d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:09.409927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e988e2d-b2f5-4190-8f0c-194974e9622d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:09.410347 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e988e2d-b2f5-4190-8f0c-194974e9622d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:09.540376 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff57f9aa-7344-4933-9d34-8b8675bc6035 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:09.541008 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff57f9aa-7344-4933-9d34-8b8675bc6035 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:09.548555 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff57f9aa-7344-4933-9d34-8b8675bc6035 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:09.549003 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff57f9aa-7344-4933-9d34-8b8675bc6035 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:09.549830 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff57f9aa-7344-4933-9d34-8b8675bc6035 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:09.550262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff57f9aa-7344-4933-9d34-8b8675bc6035 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:09.569281 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2e988e2d-b2f5-4190-8f0c-194974e9622d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:09.576994 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2e988e2d-b2f5-4190-8f0c-194974e9622d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.179039 Jul 04 05:56:09.577911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 136/246] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:09 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:09.688534 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ff57f9aa-7344-4933-9d34-8b8675bc6035 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:09.701649 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff57f9aa-7344-4933-9d34-8b8675bc6035 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.166024 Jul 04 05:56:09.702727 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 111/247] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:09 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:09.716672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f7839960-8610-46b9-a75c-6fe90fe7a990 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:09.717551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f7839960-8610-46b9-a75c-6fe90fe7a990 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:09.724062 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7839960-8610-46b9-a75c-6fe90fe7a990 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:09.724587 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7839960-8610-46b9-a75c-6fe90fe7a990 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:09.725529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7839960-8610-46b9-a75c-6fe90fe7a990 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:09.726022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7839960-8610-46b9-a75c-6fe90fe7a990 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:09.744810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:09.791830 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f7839960-8610-46b9-a75c-6fe90fe7a990 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:09.799820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f7839960-8610-46b9-a75c-6fe90fe7a990 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1292 microversion: 2.1 time: 0.087177 Jul 04 05:56:09.800376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 137/248] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:09 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:09.923077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e6b78d7-f7e3-468f-b0d7-1eab664da923 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3a3574d-2743-4404-ac39-84dff0dc7fa5"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:09.924425 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e6b78d7-f7e3-468f-b0d7-1eab664da923 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:09.930416 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e6b78d7-f7e3-468f-b0d7-1eab664da923 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:09.930857 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e6b78d7-f7e3-468f-b0d7-1eab664da923 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:09.931640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e6b78d7-f7e3-468f-b0d7-1eab664da923 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:09.932138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e6b78d7-f7e3-468f-b0d7-1eab664da923 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:09.948983 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:10.246657 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e6b78d7-f7e3-468f-b0d7-1eab664da923 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "POST /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327596 Jul 04 05:56:10.248609 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 112/249] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jul 4 05:56:09 2022] POST /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:56:10.282310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d9dd01a4-9622-4b08-86e0-2733a08d97c7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:10.285477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d9dd01a4-9622-4b08-86e0-2733a08d97c7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:10.299409 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:10.301411 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9dd01a4-9622-4b08-86e0-2733a08d97c7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:10.302124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9dd01a4-9622-4b08-86e0-2733a08d97c7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:10.314473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9dd01a4-9622-4b08-86e0-2733a08d97c7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:10.316948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9dd01a4-9622-4b08-86e0-2733a08d97c7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:10.562523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9dd01a4-9622-4b08-86e0-2733a08d97c7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:10.573182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9dd01a4-9622-4b08-86e0-2733a08d97c7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:10.574729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9dd01a4-9622-4b08-86e0-2733a08d97c7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:10.575939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d9dd01a4-9622-4b08-86e0-2733a08d97c7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1743 microversion: 2.20 time: 0.302334 Jul 04 05:56:10.576509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 138/250] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:10 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1743 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:10.594563 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad63d62b-e843-4f50-81c3-deebe4873cde tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:10.596043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ad63d62b-e843-4f50-81c3-deebe4873cde tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:10.603632 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad63d62b-e843-4f50-81c3-deebe4873cde tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:10.604172 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad63d62b-e843-4f50-81c3-deebe4873cde tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:10.605023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad63d62b-e843-4f50-81c3-deebe4873cde tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:10.605560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad63d62b-e843-4f50-81c3-deebe4873cde tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:10.720775 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8afc1e1c-bbf5-4bb6-8257-9b2c7d25263d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:10.721639 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8afc1e1c-bbf5-4bb6-8257-9b2c7d25263d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:10.729717 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8afc1e1c-bbf5-4bb6-8257-9b2c7d25263d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:10.729974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8afc1e1c-bbf5-4bb6-8257-9b2c7d25263d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:10.730738 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8afc1e1c-bbf5-4bb6-8257-9b2c7d25263d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:10.731162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8afc1e1c-bbf5-4bb6-8257-9b2c7d25263d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:10.751388 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad63d62b-e843-4f50-81c3-deebe4873cde tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:10.759876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ad63d62b-e843-4f50-81c3-deebe4873cde tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.168846 Jul 04 05:56:10.760867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 113/251] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:10 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:10.816661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bcea78c4-d747-421f-9439-6f803db9b98a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:10.817267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bcea78c4-d747-421f-9439-6f803db9b98a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:10.823784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcea78c4-d747-421f-9439-6f803db9b98a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:10.824267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcea78c4-d747-421f-9439-6f803db9b98a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:10.825037 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcea78c4-d747-421f-9439-6f803db9b98a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:10.825508 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcea78c4-d747-421f-9439-6f803db9b98a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:10.888929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bcea78c4-d747-421f-9439-6f803db9b98a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:10.897330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bcea78c4-d747-421f-9439-6f803db9b98a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1298 microversion: 2.1 time: 0.084498 Jul 04 05:56:10.897910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 114/252] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:10 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:10.967041 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8afc1e1c-bbf5-4bb6-8257-9b2c7d25263d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:10.974988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8afc1e1c-bbf5-4bb6-8257-9b2c7d25263d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.258246 Jul 04 05:56:10.975597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 139/253] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:10 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:11.598947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5aacf27c-794d-4a25-9eb8-90826c31ddc5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:11.600130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5aacf27c-794d-4a25-9eb8-90826c31ddc5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:11.611152 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5aacf27c-794d-4a25-9eb8-90826c31ddc5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:11.611961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5aacf27c-794d-4a25-9eb8-90826c31ddc5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:11.613288 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5aacf27c-794d-4a25-9eb8-90826c31ddc5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:11.613728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5aacf27c-794d-4a25-9eb8-90826c31ddc5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:11.746653 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5aacf27c-794d-4a25-9eb8-90826c31ddc5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:11.755282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5aacf27c-794d-4a25-9eb8-90826c31ddc5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:11.756838 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5aacf27c-794d-4a25-9eb8-90826c31ddc5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:11.758006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5aacf27c-794d-4a25-9eb8-90826c31ddc5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1743 microversion: 2.20 time: 0.165680 Jul 04 05:56:11.758571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 115/254] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:11 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:11.777743 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dc366a74-f89d-4167-833f-48f6d7b8a481 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:11.778309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dc366a74-f89d-4167-833f-48f6d7b8a481 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:11.785329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc366a74-f89d-4167-833f-48f6d7b8a481 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:11.785755 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc366a74-f89d-4167-833f-48f6d7b8a481 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:11.786517 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc366a74-f89d-4167-833f-48f6d7b8a481 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:11.786945 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc366a74-f89d-4167-833f-48f6d7b8a481 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:11.914374 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4703c329-93c4-43b9-9ba4-a027ee3f4a4e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:11.914987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4703c329-93c4-43b9-9ba4-a027ee3f4a4e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:11.916704 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dc366a74-f89d-4167-833f-48f6d7b8a481 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:11.921410 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4703c329-93c4-43b9-9ba4-a027ee3f4a4e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:11.922227 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4703c329-93c4-43b9-9ba4-a027ee3f4a4e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:11.923091 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4703c329-93c4-43b9-9ba4-a027ee3f4a4e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:11.923637 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4703c329-93c4-43b9-9ba4-a027ee3f4a4e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:11.925035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dc366a74-f89d-4167-833f-48f6d7b8a481 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.151170 Jul 04 05:56:11.925606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 140/255] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:11 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:11.992686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-53f17d1b-c2c2-47ba-aa56-b3019f97f439 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:11.993289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-53f17d1b-c2c2-47ba-aa56-b3019f97f439 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:11.999432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53f17d1b-c2c2-47ba-aa56-b3019f97f439 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:11.999876 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53f17d1b-c2c2-47ba-aa56-b3019f97f439 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:12.000630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53f17d1b-c2c2-47ba-aa56-b3019f97f439 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:12.001057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53f17d1b-c2c2-47ba-aa56-b3019f97f439 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:12.061638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4703c329-93c4-43b9-9ba4-a027ee3f4a4e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:12.069428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4703c329-93c4-43b9-9ba4-a027ee3f4a4e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.159162 Jul 04 05:56:12.069995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 116/256] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:11 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:12.135931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-53f17d1b-c2c2-47ba-aa56-b3019f97f439 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:12.143839 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-53f17d1b-c2c2-47ba-aa56-b3019f97f439 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.155553 Jul 04 05:56:12.144412 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 141/257] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:11 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:12.780771 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-305b5bcb-c619-47d8-864c-c457f2890fad tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:12.781674 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-305b5bcb-c619-47d8-864c-c457f2890fad tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:12.790112 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-305b5bcb-c619-47d8-864c-c457f2890fad tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:12.790556 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-305b5bcb-c619-47d8-864c-c457f2890fad tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:12.791344 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-305b5bcb-c619-47d8-864c-c457f2890fad tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:12.791767 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-305b5bcb-c619-47d8-864c-c457f2890fad tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:12.928717 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-305b5bcb-c619-47d8-864c-c457f2890fad tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:12.936892 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-305b5bcb-c619-47d8-864c-c457f2890fad tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:12.941219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-305b5bcb-c619-47d8-864c-c457f2890fad tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:12.941902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea031baf-1626-474e-b9d8-23b5de69be32 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:12.942382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-305b5bcb-c619-47d8-864c-c457f2890fad tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1743 microversion: 2.20 time: 0.168179 Jul 04 05:56:12.942563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea031baf-1626-474e-b9d8-23b5de69be32 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:12.942950 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 117/258] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:12 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:12.948711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea031baf-1626-474e-b9d8-23b5de69be32 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:12.949160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea031baf-1626-474e-b9d8-23b5de69be32 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:12.949913 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea031baf-1626-474e-b9d8-23b5de69be32 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:12.950341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea031baf-1626-474e-b9d8-23b5de69be32 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:13.086369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b5877c59-54c0-4759-b3ae-c20b2a7ce558 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:13.086978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b5877c59-54c0-4759-b3ae-c20b2a7ce558 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:13.093973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea031baf-1626-474e-b9d8-23b5de69be32 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:13.095181 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5877c59-54c0-4759-b3ae-c20b2a7ce558 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:13.095870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5877c59-54c0-4759-b3ae-c20b2a7ce558 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:13.097110 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5877c59-54c0-4759-b3ae-c20b2a7ce558 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:13.097677 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5877c59-54c0-4759-b3ae-c20b2a7ce558 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:13.103585 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea031baf-1626-474e-b9d8-23b5de69be32 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.165484 Jul 04 05:56:13.104216 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 142/259] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:12 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:13.160821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5f5cd4f-8ea6-45c3-8840-4ffd707bb94e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:13.161426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5f5cd4f-8ea6-45c3-8840-4ffd707bb94e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:13.167764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5f5cd4f-8ea6-45c3-8840-4ffd707bb94e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:13.168235 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5f5cd4f-8ea6-45c3-8840-4ffd707bb94e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:13.168973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5f5cd4f-8ea6-45c3-8840-4ffd707bb94e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:13.169431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5f5cd4f-8ea6-45c3-8840-4ffd707bb94e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:13.225117 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b5877c59-54c0-4759-b3ae-c20b2a7ce558 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:13.232880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b5877c59-54c0-4759-b3ae-c20b2a7ce558 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.150796 Jul 04 05:56:13.233678 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 118/260] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:13 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:13.295884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d5f5cd4f-8ea6-45c3-8840-4ffd707bb94e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:13.304348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5f5cd4f-8ea6-45c3-8840-4ffd707bb94e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.147626 Jul 04 05:56:13.305048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 143/261] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:13 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:13.960160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cf1e17e5-4d65-4bf0-aaf2-ce0811357da2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:13.960764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cf1e17e5-4d65-4bf0-aaf2-ce0811357da2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:13.967698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf1e17e5-4d65-4bf0-aaf2-ce0811357da2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:13.968147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf1e17e5-4d65-4bf0-aaf2-ce0811357da2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:13.968916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf1e17e5-4d65-4bf0-aaf2-ce0811357da2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:13.969352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf1e17e5-4d65-4bf0-aaf2-ce0811357da2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:14.109084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cf1e17e5-4d65-4bf0-aaf2-ce0811357da2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:14.117610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cf1e17e5-4d65-4bf0-aaf2-ce0811357da2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:14.119095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cf1e17e5-4d65-4bf0-aaf2-ce0811357da2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:14.120271 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cf1e17e5-4d65-4bf0-aaf2-ce0811357da2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1743 microversion: 2.20 time: 0.164118 Jul 04 05:56:14.120422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-606e019e-2d87-47b9-b929-daf2586223e9 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:14.120978 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-606e019e-2d87-47b9-b929-daf2586223e9 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:14.121115 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 119/262] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:13 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:14.127681 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606e019e-2d87-47b9-b929-daf2586223e9 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:14.128139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606e019e-2d87-47b9-b929-daf2586223e9 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:14.128969 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606e019e-2d87-47b9-b929-daf2586223e9 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:14.129400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606e019e-2d87-47b9-b929-daf2586223e9 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:14.250151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01c068ed-8cfc-4071-bf03-9828cd3a1475 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:14.250755 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01c068ed-8cfc-4071-bf03-9828cd3a1475 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:14.257066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c068ed-8cfc-4071-bf03-9828cd3a1475 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:14.257518 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c068ed-8cfc-4071-bf03-9828cd3a1475 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:14.258287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c068ed-8cfc-4071-bf03-9828cd3a1475 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:14.258724 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c068ed-8cfc-4071-bf03-9828cd3a1475 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:14.265751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-606e019e-2d87-47b9-b929-daf2586223e9 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:14.273547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-606e019e-2d87-47b9-b929-daf2586223e9 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.156982 Jul 04 05:56:14.274136 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 144/263] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:14 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:14.321267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e02863e-aebe-4139-95f7-8664a41a0909 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:14.321924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7e02863e-aebe-4139-95f7-8664a41a0909 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:14.328147 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e02863e-aebe-4139-95f7-8664a41a0909 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:14.328595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e02863e-aebe-4139-95f7-8664a41a0909 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:14.329359 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e02863e-aebe-4139-95f7-8664a41a0909 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:14.329812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e02863e-aebe-4139-95f7-8664a41a0909 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:14.390381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01c068ed-8cfc-4071-bf03-9828cd3a1475 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:14.399315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01c068ed-8cfc-4071-bf03-9828cd3a1475 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.152911 Jul 04 05:56:14.409850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 120/264] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:14 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:14.516139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-74f4a5ca-1048-4b38-aba5-b760da858c61 req-3b853aee-28bf-4f63-80e5-575dc9434418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6a82fd-4ec7-4019-97b0-bda931a3b48d", "name": "network-vif-plugged", "status": "completed", "tag": "b2717eda-04d8-4f3b-9fe7-7ec276183cc0"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:14.523838 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-74f4a5ca-1048-4b38-aba5-b760da858c61 req-3b853aee-28bf-4f63-80e5-575dc9434418 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:14.526118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-74f4a5ca-1048-4b38-aba5-b760da858c61 req-3b853aee-28bf-4f63-80e5-575dc9434418 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:14.530371 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e02863e-aebe-4139-95f7-8664a41a0909 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:14.540098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7e02863e-aebe-4139-95f7-8664a41a0909 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.222608 Jul 04 05:56:14.541884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 145/265] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:14 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:14.561967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-74f4a5ca-1048-4b38-aba5-b760da858c61 req-3b853aee-28bf-4f63-80e5-575dc9434418 service nova] Creating event network-vif-plugged:b2717eda-04d8-4f3b-9fe7-7ec276183cc0 for instance 4f6a82fd-4ec7-4019-97b0-bda931a3b48d on hv-cinder-79733 Jul 04 05:56:14.568912 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-74f4a5ca-1048-4b38-aba5-b760da858c61 req-3b853aee-28bf-4f63-80e5-575dc9434418 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062063 Jul 04 05:56:14.570044 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 121/266] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:56:15.143742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cedb952b-245e-42c6-bed6-b04062094ef4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:15.145430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cedb952b-245e-42c6-bed6-b04062094ef4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:15.153899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cedb952b-245e-42c6-bed6-b04062094ef4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:15.154592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cedb952b-245e-42c6-bed6-b04062094ef4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:15.155696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cedb952b-245e-42c6-bed6-b04062094ef4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:15.156550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cedb952b-245e-42c6-bed6-b04062094ef4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:15.294147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d1cb3bd6-16ee-4a82-8e5b-c15dc2be3c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:15.295803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d1cb3bd6-16ee-4a82-8e5b-c15dc2be3c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:15.314746 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1cb3bd6-16ee-4a82-8e5b-c15dc2be3c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:15.315495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1cb3bd6-16ee-4a82-8e5b-c15dc2be3c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:15.317266 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1cb3bd6-16ee-4a82-8e5b-c15dc2be3c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:15.318053 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1cb3bd6-16ee-4a82-8e5b-c15dc2be3c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:15.395382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cedb952b-245e-42c6-bed6-b04062094ef4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:15.404011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cedb952b-245e-42c6-bed6-b04062094ef4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:15.405508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cedb952b-245e-42c6-bed6-b04062094ef4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:15.411897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cedb952b-245e-42c6-bed6-b04062094ef4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1738 microversion: 2.20 time: 0.276040 Jul 04 05:56:15.412494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 146/267] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:15 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:15.427769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-83c82c86-7e85-4815-84ad-910f8de7930a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:15.428418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-83c82c86-7e85-4815-84ad-910f8de7930a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:15.434592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83c82c86-7e85-4815-84ad-910f8de7930a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:15.435533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83c82c86-7e85-4815-84ad-910f8de7930a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:15.436587 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83c82c86-7e85-4815-84ad-910f8de7930a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:15.437198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83c82c86-7e85-4815-84ad-910f8de7930a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:15.540040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d1cb3bd6-16ee-4a82-8e5b-c15dc2be3c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:15.551494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d1cb3bd6-16ee-4a82-8e5b-c15dc2be3c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.263242 Jul 04 05:56:15.552912 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 122/268] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:15 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:15.558081 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-be87ac8f-6410-4781-9eaf-ab6b814bd19a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:15.558846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-be87ac8f-6410-4781-9eaf-ab6b814bd19a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:15.567286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be87ac8f-6410-4781-9eaf-ab6b814bd19a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:15.568015 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be87ac8f-6410-4781-9eaf-ab6b814bd19a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:15.569012 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be87ac8f-6410-4781-9eaf-ab6b814bd19a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:15.569599 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be87ac8f-6410-4781-9eaf-ab6b814bd19a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:15.733458 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-83c82c86-7e85-4815-84ad-910f8de7930a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:15.759325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-83c82c86-7e85-4815-84ad-910f8de7930a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.333186 Jul 04 05:56:15.762767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 147/269] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:15 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:15.777587 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-2bb612af-3097-4e1c-8a94-ae0721295796 req-38944645-2ec9-4ad0-a76f-02283671c6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5a689e-ec6d-40f5-beeb-36326b13fb0b", "tag": "be2b55c5-eb0b-48a8-a754-efe9ce27c3a4"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:15.789565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-2bb612af-3097-4e1c-8a94-ae0721295796 req-38944645-2ec9-4ad0-a76f-02283671c6d1 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:15.792357 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-2bb612af-3097-4e1c-8a94-ae0721295796 req-38944645-2ec9-4ad0-a76f-02283671c6d1 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:15.813723 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-2bb612af-3097-4e1c-8a94-ae0721295796 req-38944645-2ec9-4ad0-a76f-02283671c6d1 service nova] Creating event network-changed:be2b55c5-eb0b-48a8-a754-efe9ce27c3a4 for instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b on hv-cinder-79733 Jul 04 05:56:15.822562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-2bb612af-3097-4e1c-8a94-ae0721295796 req-38944645-2ec9-4ad0-a76f-02283671c6d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057956 Jul 04 05:56:15.825536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 148/270] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:56:15.871281 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-be87ac8f-6410-4781-9eaf-ab6b814bd19a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:15.888431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-be87ac8f-6410-4781-9eaf-ab6b814bd19a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.333143 Jul 04 05:56:15.897846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 123/271] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:15 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:16.432693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c06e88d3-0f30-4a25-ad1b-fc72f6a64e4b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:16.434530 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c06e88d3-0f30-4a25-ad1b-fc72f6a64e4b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:16.445268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c06e88d3-0f30-4a25-ad1b-fc72f6a64e4b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:16.448111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c06e88d3-0f30-4a25-ad1b-fc72f6a64e4b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:16.448906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c06e88d3-0f30-4a25-ad1b-fc72f6a64e4b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:16.449335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c06e88d3-0f30-4a25-ad1b-fc72f6a64e4b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:16.493742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=12 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:16.569349 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5522dc27-ffa1-4478-ab1d-9900a0370f6d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:16.570036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5522dc27-ffa1-4478-ab1d-9900a0370f6d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:16.574066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:16.574772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=8 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:16.589750 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5522dc27-ffa1-4478-ab1d-9900a0370f6d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:16.590371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5522dc27-ffa1-4478-ab1d-9900a0370f6d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:16.591409 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5522dc27-ffa1-4478-ab1d-9900a0370f6d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:16.591854 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5522dc27-ffa1-4478-ab1d-9900a0370f6d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:16.725331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c06e88d3-0f30-4a25-ad1b-fc72f6a64e4b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:16.737365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c06e88d3-0f30-4a25-ad1b-fc72f6a64e4b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:16.739702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c06e88d3-0f30-4a25-ad1b-fc72f6a64e4b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:16.741075 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c06e88d3-0f30-4a25-ad1b-fc72f6a64e4b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1738 microversion: 2.20 time: 0.313354 Jul 04 05:56:16.742230 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 149/272] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:16 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:16.780544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f846b7eb-97aa-4c9f-9b70-7c014d94eefb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:16.782754 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f846b7eb-97aa-4c9f-9b70-7c014d94eefb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:16.799606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f846b7eb-97aa-4c9f-9b70-7c014d94eefb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:16.806662 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f846b7eb-97aa-4c9f-9b70-7c014d94eefb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:16.807679 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f846b7eb-97aa-4c9f-9b70-7c014d94eefb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:16.808377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f846b7eb-97aa-4c9f-9b70-7c014d94eefb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:16.855760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5522dc27-ffa1-4478-ab1d-9900a0370f6d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:16.868161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5522dc27-ffa1-4478-ab1d-9900a0370f6d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1313 microversion: 2.1 time: 0.303266 Jul 04 05:56:16.879354 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 124/273] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:16 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:16.905271 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2df4c191-1cb9-4a87-a275-1f4808973ad3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:16.906117 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2df4c191-1cb9-4a87-a275-1f4808973ad3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:16.914988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:16.921119 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2df4c191-1cb9-4a87-a275-1f4808973ad3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:16.922164 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2df4c191-1cb9-4a87-a275-1f4808973ad3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:16.925590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2df4c191-1cb9-4a87-a275-1f4808973ad3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:16.926213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2df4c191-1cb9-4a87-a275-1f4808973ad3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:17.109213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2df4c191-1cb9-4a87-a275-1f4808973ad3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:17.127875 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2df4c191-1cb9-4a87-a275-1f4808973ad3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.218369 Jul 04 05:56:17.129246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 125/274] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:16 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:17.192614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f846b7eb-97aa-4c9f-9b70-7c014d94eefb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:17.205129 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f846b7eb-97aa-4c9f-9b70-7c014d94eefb tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.429841 Jul 04 05:56:17.206257 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 150/275] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:16 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:17.766440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b1f92e44-19ae-4221-adee-bc6f5a6965a0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:17.767073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b1f92e44-19ae-4221-adee-bc6f5a6965a0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:17.783936 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1f92e44-19ae-4221-adee-bc6f5a6965a0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:17.788304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1f92e44-19ae-4221-adee-bc6f5a6965a0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:17.789429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1f92e44-19ae-4221-adee-bc6f5a6965a0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:17.791158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1f92e44-19ae-4221-adee-bc6f5a6965a0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:17.898005 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-677b503d-46a1-489e-a09c-6e5e1691c8f2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:17.898627 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-677b503d-46a1-489e-a09c-6e5e1691c8f2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:17.917000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-677b503d-46a1-489e-a09c-6e5e1691c8f2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:17.918043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-677b503d-46a1-489e-a09c-6e5e1691c8f2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:17.920133 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-677b503d-46a1-489e-a09c-6e5e1691c8f2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:17.922166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-677b503d-46a1-489e-a09c-6e5e1691c8f2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:18.048653 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b1f92e44-19ae-4221-adee-bc6f5a6965a0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:18.061639 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b1f92e44-19ae-4221-adee-bc6f5a6965a0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:18.063456 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b1f92e44-19ae-4221-adee-bc6f5a6965a0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:18.064820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b1f92e44-19ae-4221-adee-bc6f5a6965a0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1738 microversion: 2.20 time: 0.306244 Jul 04 05:56:18.065549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 126/276] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:17 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:18.117987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-677b503d-46a1-489e-a09c-6e5e1691c8f2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:18.127571 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-677b503d-46a1-489e-a09c-6e5e1691c8f2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1498 microversion: 2.1 time: 0.245349 Jul 04 05:56:18.128673 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 151/277] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:17 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1498 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:18.151066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e22f52aa-7ff8-4163-81f9-e0e008592b2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:18.151971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e22f52aa-7ff8-4163-81f9-e0e008592b2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:18.158575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e22f52aa-7ff8-4163-81f9-e0e008592b2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:18.159092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e22f52aa-7ff8-4163-81f9-e0e008592b2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:18.160192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e22f52aa-7ff8-4163-81f9-e0e008592b2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:18.160842 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e22f52aa-7ff8-4163-81f9-e0e008592b2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:18.229063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2aabef56-87a8-4cc9-b6f4-fad6a380ec5c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:18.229789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2aabef56-87a8-4cc9-b6f4-fad6a380ec5c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:18.236255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2aabef56-87a8-4cc9-b6f4-fad6a380ec5c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:18.239098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2aabef56-87a8-4cc9-b6f4-fad6a380ec5c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:18.252402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2aabef56-87a8-4cc9-b6f4-fad6a380ec5c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:18.252945 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2aabef56-87a8-4cc9-b6f4-fad6a380ec5c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:18.423912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2aabef56-87a8-4cc9-b6f4-fad6a380ec5c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:18.434274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2aabef56-87a8-4cc9-b6f4-fad6a380ec5c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.210129 Jul 04 05:56:18.435641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 152/278] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:18 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:18.674922 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e22f52aa-7ff8-4163-81f9-e0e008592b2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:18.685022 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e22f52aa-7ff8-4163-81f9-e0e008592b2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.544309 Jul 04 05:56:18.695219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 127/279] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:18 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:18.701649 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-558a4097-bc41-4ab5-907e-47a492bb2692 req-5ecaf610-258c-443f-9db6-7ee214f5b3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178121f0-a865-467e-a46a-069b621b6d17", "name": "network-vif-plugged", "status": "completed", "tag": "27020a65-ee8e-4790-a27b-3983dfc85818"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:18.713193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-558a4097-bc41-4ab5-907e-47a492bb2692 req-5ecaf610-258c-443f-9db6-7ee214f5b3b3 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:18.714579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-558a4097-bc41-4ab5-907e-47a492bb2692 req-5ecaf610-258c-443f-9db6-7ee214f5b3b3 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:18.749766 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-558a4097-bc41-4ab5-907e-47a492bb2692 req-5ecaf610-258c-443f-9db6-7ee214f5b3b3 service nova] Creating event network-vif-plugged:27020a65-ee8e-4790-a27b-3983dfc85818 for instance 178121f0-a865-467e-a46a-069b621b6d17 on hv-cinder-79733 Jul 04 05:56:18.761654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-558a4097-bc41-4ab5-907e-47a492bb2692 req-5ecaf610-258c-443f-9db6-7ee214f5b3b3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064992 Jul 04 05:56:18.765532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 153/280] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:56:18.798942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-136bd300-6b09-40d7-8d68-6ac00f462150 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:18.800375 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-136bd300-6b09-40d7-8d68-6ac00f462150 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:18.808379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-136bd300-6b09-40d7-8d68-6ac00f462150 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:18.809230 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-136bd300-6b09-40d7-8d68-6ac00f462150 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:18.810221 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-136bd300-6b09-40d7-8d68-6ac00f462150 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:18.810862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-136bd300-6b09-40d7-8d68-6ac00f462150 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:18.837325 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:18.847208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-136bd300-6b09-40d7-8d68-6ac00f462150 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 05:56:18.952892 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-136bd300-6b09-40d7-8d68-6ac00f462150 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 204 len: 0 microversion: 2.1 time: 0.157708 Jul 04 05:56:18.958068 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 128/281] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 05:56:18 2022] DELETE /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 05:56:18.965455 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8d89d534-9c4e-4d3e-8db3-aac68fb8680c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:18.967007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8d89d534-9c4e-4d3e-8db3-aac68fb8680c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:18.976029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d89d534-9c4e-4d3e-8db3-aac68fb8680c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:18.977280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d89d534-9c4e-4d3e-8db3-aac68fb8680c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:18.978292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d89d534-9c4e-4d3e-8db3-aac68fb8680c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:18.978912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d89d534-9c4e-4d3e-8db3-aac68fb8680c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:19.086463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f42920ec-c906-47dd-9612-4b15b58d1a94 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:19.087496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f42920ec-c906-47dd-9612-4b15b58d1a94 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:19.098356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f42920ec-c906-47dd-9612-4b15b58d1a94 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:19.098804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f42920ec-c906-47dd-9612-4b15b58d1a94 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:19.099632 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f42920ec-c906-47dd-9612-4b15b58d1a94 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:19.100045 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f42920ec-c906-47dd-9612-4b15b58d1a94 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:19.208318 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8d89d534-9c4e-4d3e-8db3-aac68fb8680c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:19.219542 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8d89d534-9c4e-4d3e-8db3-aac68fb8680c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1504 microversion: 2.1 time: 0.258992 Jul 04 05:56:19.229502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 154/282] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:18 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:19.452534 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ada72190-9d6d-4314-aeaa-d1d70a3f3dcf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:19.453100 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ada72190-9d6d-4314-aeaa-d1d70a3f3dcf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:19.467832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ada72190-9d6d-4314-aeaa-d1d70a3f3dcf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:19.468380 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ada72190-9d6d-4314-aeaa-d1d70a3f3dcf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:19.480096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ada72190-9d6d-4314-aeaa-d1d70a3f3dcf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:19.480543 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ada72190-9d6d-4314-aeaa-d1d70a3f3dcf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:19.519852 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:19.588822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f42920ec-c906-47dd-9612-4b15b58d1a94 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:19.599878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f42920ec-c906-47dd-9612-4b15b58d1a94 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:19.601476 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f42920ec-c906-47dd-9612-4b15b58d1a94 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:19.603435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f42920ec-c906-47dd-9612-4b15b58d1a94 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1738 microversion: 2.20 time: 0.521262 Jul 04 05:56:19.614761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 129/283] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:19 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1738 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:19.701964 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-564e182c-330c-4aa6-bf5c-e5ac5ff5bda6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:19.711695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ada72190-9d6d-4314-aeaa-d1d70a3f3dcf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:19.724310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-564e182c-330c-4aa6-bf5c-e5ac5ff5bda6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:19.729492 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ada72190-9d6d-4314-aeaa-d1d70a3f3dcf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.279604 Jul 04 05:56:19.730605 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 155/284] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:19 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:19.740989 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-564e182c-330c-4aa6-bf5c-e5ac5ff5bda6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:19.741819 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-564e182c-330c-4aa6-bf5c-e5ac5ff5bda6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:19.742719 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-564e182c-330c-4aa6-bf5c-e5ac5ff5bda6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:19.743289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-564e182c-330c-4aa6-bf5c-e5ac5ff5bda6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:19.913530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-564e182c-330c-4aa6-bf5c-e5ac5ff5bda6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:19.924861 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-564e182c-330c-4aa6-bf5c-e5ac5ff5bda6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.226501 Jul 04 05:56:19.926273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 130/285] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:19 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:20.237493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6f1e91d3-06b0-4c41-a143-128653e0f431 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:20.238196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6f1e91d3-06b0-4c41-a143-128653e0f431 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:20.245308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f1e91d3-06b0-4c41-a143-128653e0f431 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:20.245753 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f1e91d3-06b0-4c41-a143-128653e0f431 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:20.248825 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f1e91d3-06b0-4c41-a143-128653e0f431 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:20.250431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f1e91d3-06b0-4c41-a143-128653e0f431 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:20.626688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dc09cc55-e6fe-4263-86e6-021639986c3a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:20.628251 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dc09cc55-e6fe-4263-86e6-021639986c3a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:20.641241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc09cc55-e6fe-4263-86e6-021639986c3a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:20.644373 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc09cc55-e6fe-4263-86e6-021639986c3a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:20.645393 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc09cc55-e6fe-4263-86e6-021639986c3a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:20.647212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc09cc55-e6fe-4263-86e6-021639986c3a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:20.725399 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6f1e91d3-06b0-4c41-a143-128653e0f431 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:20.742889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6f1e91d3-06b0-4c41-a143-128653e0f431 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1504 microversion: 2.1 time: 0.509685 Jul 04 05:56:20.752456 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 156/286] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:20 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1504 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:20.780706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2b0bfdf9-798b-4c9c-81b7-7036e9dbf3c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:20.785560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2b0bfdf9-798b-4c9c-81b7-7036e9dbf3c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:20.819711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b0bfdf9-798b-4c9c-81b7-7036e9dbf3c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:20.820152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b0bfdf9-798b-4c9c-81b7-7036e9dbf3c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:20.827589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b0bfdf9-798b-4c9c-81b7-7036e9dbf3c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:20.829945 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b0bfdf9-798b-4c9c-81b7-7036e9dbf3c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:21.008848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dc09cc55-e6fe-4263-86e6-021639986c3a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:21.017484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dc09cc55-e6fe-4263-86e6-021639986c3a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:21.022896 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dc09cc55-e6fe-4263-86e6-021639986c3a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:21.024852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dc09cc55-e6fe-4263-86e6-021639986c3a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1738 microversion: 2.20 time: 0.404978 Jul 04 05:56:21.025749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 131/287] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:20 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1738 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:21.041439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-795ccba5-5cb5-4b6c-b3ec-80032e16de00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:21.042071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-795ccba5-5cb5-4b6c-b3ec-80032e16de00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:21.062047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-795ccba5-5cb5-4b6c-b3ec-80032e16de00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:21.062994 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-795ccba5-5cb5-4b6c-b3ec-80032e16de00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:21.063896 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-795ccba5-5cb5-4b6c-b3ec-80032e16de00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:21.065540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-795ccba5-5cb5-4b6c-b3ec-80032e16de00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:21.070353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2b0bfdf9-798b-4c9c-81b7-7036e9dbf3c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:21.093610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2b0bfdf9-798b-4c9c-81b7-7036e9dbf3c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.339946 Jul 04 05:56:21.095768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 157/288] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:20 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:21.348793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-795ccba5-5cb5-4b6c-b3ec-80032e16de00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:21.361079 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-795ccba5-5cb5-4b6c-b3ec-80032e16de00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.334181 Jul 04 05:56:21.362630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 132/289] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:21 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:21.770553 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-60c1c4f0-6549-472e-a8d7-5e252837c884 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:21.771105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-60c1c4f0-6549-472e-a8d7-5e252837c884 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:21.781248 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60c1c4f0-6549-472e-a8d7-5e252837c884 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:21.781695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60c1c4f0-6549-472e-a8d7-5e252837c884 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:21.783951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60c1c4f0-6549-472e-a8d7-5e252837c884 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:21.784447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60c1c4f0-6549-472e-a8d7-5e252837c884 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:22.044381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-60c1c4f0-6549-472e-a8d7-5e252837c884 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:22.050810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6b1d6d87-db76-4a46-bc66-34f03895255e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:22.052061 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6b1d6d87-db76-4a46-bc66-34f03895255e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:22.057165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-60c1c4f0-6549-472e-a8d7-5e252837c884 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1504 microversion: 2.1 time: 0.292670 Jul 04 05:56:22.059937 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 158/290] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:21 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:22.060777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b1d6d87-db76-4a46-bc66-34f03895255e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:22.061547 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b1d6d87-db76-4a46-bc66-34f03895255e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:22.062593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b1d6d87-db76-4a46-bc66-34f03895255e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:22.063145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b1d6d87-db76-4a46-bc66-34f03895255e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:22.110379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bda5fe48-03d9-4e78-8370-5b1bc34cf71a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:22.111549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bda5fe48-03d9-4e78-8370-5b1bc34cf71a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:22.124032 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bda5fe48-03d9-4e78-8370-5b1bc34cf71a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:22.125102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bda5fe48-03d9-4e78-8370-5b1bc34cf71a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:22.127975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bda5fe48-03d9-4e78-8370-5b1bc34cf71a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:22.128780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bda5fe48-03d9-4e78-8370-5b1bc34cf71a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:22.326850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b1d6d87-db76-4a46-bc66-34f03895255e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:22.336435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b1d6d87-db76-4a46-bc66-34f03895255e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:22.344747 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b1d6d87-db76-4a46-bc66-34f03895255e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:22.355672 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6b1d6d87-db76-4a46-bc66-34f03895255e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1738 microversion: 2.20 time: 0.304075 Jul 04 05:56:22.356666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 133/291] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:22 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1738 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:22.380451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-22590a86-e958-4594-82b2-a12027d4d992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:22.381726 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-22590a86-e958-4594-82b2-a12027d4d992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:22.393329 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22590a86-e958-4594-82b2-a12027d4d992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:22.394074 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22590a86-e958-4594-82b2-a12027d4d992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:22.395226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bda5fe48-03d9-4e78-8370-5b1bc34cf71a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:22.396511 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22590a86-e958-4594-82b2-a12027d4d992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:22.397179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22590a86-e958-4594-82b2-a12027d4d992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:22.406530 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bda5fe48-03d9-4e78-8370-5b1bc34cf71a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.300157 Jul 04 05:56:22.423663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 159/292] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:22 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:22.640393 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-22590a86-e958-4594-82b2-a12027d4d992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:22.650197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-22590a86-e958-4594-82b2-a12027d4d992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.274239 Jul 04 05:56:22.659962 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 134/293] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:22 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:22.836578 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-f125c22e-ce34-45f9-886f-e0204b18d422 req-0d33aef5-1000-4802-a67e-626ac2886108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5a689e-ec6d-40f5-beeb-36326b13fb0b", "name": "network-vif-plugged", "status": "completed", "tag": "be2b55c5-eb0b-48a8-a754-efe9ce27c3a4"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:22.862803 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f125c22e-ce34-45f9-886f-e0204b18d422 req-0d33aef5-1000-4802-a67e-626ac2886108 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:22.863749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f125c22e-ce34-45f9-886f-e0204b18d422 req-0d33aef5-1000-4802-a67e-626ac2886108 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:22.931501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-f125c22e-ce34-45f9-886f-e0204b18d422 req-0d33aef5-1000-4802-a67e-626ac2886108 service nova] Creating event network-vif-plugged:be2b55c5-eb0b-48a8-a754-efe9ce27c3a4 for instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b on hv-cinder-79733 Jul 04 05:56:22.943837 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-f125c22e-ce34-45f9-886f-e0204b18d422 req-0d33aef5-1000-4802-a67e-626ac2886108 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114545 Jul 04 05:56:22.947438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 160/294] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:56:23.076628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-34006631-7f95-407c-8e19-4124a39cd26c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:23.078379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-34006631-7f95-407c-8e19-4124a39cd26c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:23.086414 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34006631-7f95-407c-8e19-4124a39cd26c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:23.087345 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34006631-7f95-407c-8e19-4124a39cd26c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:23.088129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34006631-7f95-407c-8e19-4124a39cd26c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:23.088568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34006631-7f95-407c-8e19-4124a39cd26c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:23.270028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-34006631-7f95-407c-8e19-4124a39cd26c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:23.280067 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-34006631-7f95-407c-8e19-4124a39cd26c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1504 microversion: 2.1 time: 0.207311 Jul 04 05:56:23.283300 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 135/295] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:23 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:23.389450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-df63e378-7f7f-479c-8700-8732a9e9f874 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:23.390139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-df63e378-7f7f-479c-8700-8732a9e9f874 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:23.404960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df63e378-7f7f-479c-8700-8732a9e9f874 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:23.405777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df63e378-7f7f-479c-8700-8732a9e9f874 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:23.406532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df63e378-7f7f-479c-8700-8732a9e9f874 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:23.406959 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df63e378-7f7f-479c-8700-8732a9e9f874 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:23.424815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0fcc581c-6e42-4f20-a46c-f5669c538c7c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:23.425463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0fcc581c-6e42-4f20-a46c-f5669c538c7c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:23.431438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fcc581c-6e42-4f20-a46c-f5669c538c7c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:23.432161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fcc581c-6e42-4f20-a46c-f5669c538c7c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:23.433136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fcc581c-6e42-4f20-a46c-f5669c538c7c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:23.433813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fcc581c-6e42-4f20-a46c-f5669c538c7c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:23.580532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df63e378-7f7f-479c-8700-8732a9e9f874 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:23.588662 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0fcc581c-6e42-4f20-a46c-f5669c538c7c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:23.590049 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df63e378-7f7f-479c-8700-8732a9e9f874 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:23.591572 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df63e378-7f7f-479c-8700-8732a9e9f874 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:23.593447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-df63e378-7f7f-479c-8700-8732a9e9f874 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1738 microversion: 2.20 time: 0.208558 Jul 04 05:56:23.599281 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0fcc581c-6e42-4f20-a46c-f5669c538c7c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.178111 Jul 04 05:56:23.606179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 161/296] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:23 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:23.610218 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 136/297] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:23 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:23.668839 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ce6f2163-d45f-4c94-abe2-3dc200d600c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:23.669475 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ce6f2163-d45f-4c94-abe2-3dc200d600c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:23.678359 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce6f2163-d45f-4c94-abe2-3dc200d600c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:23.678359 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce6f2163-d45f-4c94-abe2-3dc200d600c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:23.678359 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce6f2163-d45f-4c94-abe2-3dc200d600c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:23.679003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce6f2163-d45f-4c94-abe2-3dc200d600c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:23.835721 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ce6f2163-d45f-4c94-abe2-3dc200d600c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:23.846706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ce6f2163-d45f-4c94-abe2-3dc200d600c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.181776 Jul 04 05:56:23.848100 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 162/298] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:23 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:24.300031 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-22881533-ef6a-4757-9b94-1792c191200b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:24.301336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-22881533-ef6a-4757-9b94-1792c191200b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:24.318986 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22881533-ef6a-4757-9b94-1792c191200b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:24.319774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22881533-ef6a-4757-9b94-1792c191200b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:24.320956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22881533-ef6a-4757-9b94-1792c191200b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:24.321402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22881533-ef6a-4757-9b94-1792c191200b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:24.460108 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2000944517", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "networks": [{"uuid": "bce2b5d0-0a48-4248-902a-974ee1810a73"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:24.530441 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-22881533-ef6a-4757-9b94-1792c191200b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:24.538296 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-22881533-ef6a-4757-9b94-1792c191200b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1504 microversion: 2.1 time: 0.244488 Jul 04 05:56:24.538869 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 137/299] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:24 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:24.613717 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-941f8c47-e47f-469e-a28c-b4836ac70192 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:24.614620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-941f8c47-e47f-469e-a28c-b4836ac70192 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:24.621652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-941f8c47-e47f-469e-a28c-b4836ac70192 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:24.622382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-941f8c47-e47f-469e-a28c-b4836ac70192 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:24.623343 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-941f8c47-e47f-469e-a28c-b4836ac70192 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:24.623923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-941f8c47-e47f-469e-a28c-b4836ac70192 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:24.781140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-941f8c47-e47f-469e-a28c-b4836ac70192 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:24.790059 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-941f8c47-e47f-469e-a28c-b4836ac70192 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:24.791897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-941f8c47-e47f-469e-a28c-b4836ac70192 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:24.794242 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-941f8c47-e47f-469e-a28c-b4836ac70192 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1738 microversion: 2.20 time: 0.184541 Jul 04 05:56:24.805794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 138/300] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:24 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:24.810213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-507cf382-4ad8-4f73-a556-dd1726ea94e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:24.811324 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-507cf382-4ad8-4f73-a556-dd1726ea94e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:24.818970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-507cf382-4ad8-4f73-a556-dd1726ea94e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:24.819451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-507cf382-4ad8-4f73-a556-dd1726ea94e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:24.820236 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-507cf382-4ad8-4f73-a556-dd1726ea94e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:24.820676 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-507cf382-4ad8-4f73-a556-dd1726ea94e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:24.970822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-507cf382-4ad8-4f73-a556-dd1726ea94e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:24.978541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-507cf382-4ad8-4f73-a556-dd1726ea94e1 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.182242 Jul 04 05:56:24.988130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 139/301] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:24 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:24.992960 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a7675ff-93be-4da1-9dfb-726d6719bae7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:24.995287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a7675ff-93be-4da1-9dfb-726d6719bae7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:25.002789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a7675ff-93be-4da1-9dfb-726d6719bae7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:25.003336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a7675ff-93be-4da1-9dfb-726d6719bae7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:25.004118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a7675ff-93be-4da1-9dfb-726d6719bae7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:25.004561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a7675ff-93be-4da1-9dfb-726d6719bae7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:25.165932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a7675ff-93be-4da1-9dfb-726d6719bae7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:25.178510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a7675ff-93be-4da1-9dfb-726d6719bae7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.189234 Jul 04 05:56:25.179545 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 140/302] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:24 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:25.558739 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e759c97-9304-445a-9a23-6d1bacc9439b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:25.560469 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9e759c97-9304-445a-9a23-6d1bacc9439b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:25.570863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e759c97-9304-445a-9a23-6d1bacc9439b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:25.571508 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e759c97-9304-445a-9a23-6d1bacc9439b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:25.572516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e759c97-9304-445a-9a23-6d1bacc9439b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:25.572962 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e759c97-9304-445a-9a23-6d1bacc9439b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:25.746360 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9e759c97-9304-445a-9a23-6d1bacc9439b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:25.756130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e759c97-9304-445a-9a23-6d1bacc9439b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1504 microversion: 2.1 time: 0.203214 Jul 04 05:56:25.756977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 141/303] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:25 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:25.813915 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a3147c83-c2e0-4582-91de-d64dc4dcf96f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:25.814525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a3147c83-c2e0-4582-91de-d64dc4dcf96f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:25.821320 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3147c83-c2e0-4582-91de-d64dc4dcf96f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:25.821850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3147c83-c2e0-4582-91de-d64dc4dcf96f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:25.822679 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3147c83-c2e0-4582-91de-d64dc4dcf96f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:25.823127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3147c83-c2e0-4582-91de-d64dc4dcf96f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:25.993235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a3147c83-c2e0-4582-91de-d64dc4dcf96f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:26.010548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a3147c83-c2e0-4582-91de-d64dc4dcf96f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:26.012223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a3147c83-c2e0-4582-91de-d64dc4dcf96f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:26.013496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a3147c83-c2e0-4582-91de-d64dc4dcf96f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1738 microversion: 2.20 time: 0.204697 Jul 04 05:56:26.019757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 142/304] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:25 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:26.026089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-43b8a6f8-fb7e-4471-96ca-56e06c8f2bb9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:26.027064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-43b8a6f8-fb7e-4471-96ca-56e06c8f2bb9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:26.038367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43b8a6f8-fb7e-4471-96ca-56e06c8f2bb9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:26.041710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43b8a6f8-fb7e-4471-96ca-56e06c8f2bb9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:26.041710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43b8a6f8-fb7e-4471-96ca-56e06c8f2bb9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:26.043516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43b8a6f8-fb7e-4471-96ca-56e06c8f2bb9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:26.083696 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:26.233571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-43b8a6f8-fb7e-4471-96ca-56e06c8f2bb9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:26.242408 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-43b8a6f8-fb7e-4471-96ca-56e06c8f2bb9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.221123 Jul 04 05:56:26.252191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 143/305] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:26 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:26.257120 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2937a8eb-3edc-474c-98f5-47da8d873091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:26.257731 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2937a8eb-3edc-474c-98f5-47da8d873091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:26.272873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2937a8eb-3edc-474c-98f5-47da8d873091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:26.272873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2937a8eb-3edc-474c-98f5-47da8d873091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:26.272873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2937a8eb-3edc-474c-98f5-47da8d873091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:26.272873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2937a8eb-3edc-474c-98f5-47da8d873091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:26.417456 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2937a8eb-3edc-474c-98f5-47da8d873091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:26.448021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2937a8eb-3edc-474c-98f5-47da8d873091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.194453 Jul 04 05:56:26.457626 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 144/306] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:26 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:26.773814 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c3890751-aa97-4d05-9458-8abdac01aedb tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:26.775746 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c3890751-aa97-4d05-9458-8abdac01aedb tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:26.783028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3890751-aa97-4d05-9458-8abdac01aedb tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:26.783568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3890751-aa97-4d05-9458-8abdac01aedb tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:26.784528 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3890751-aa97-4d05-9458-8abdac01aedb tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:26.785130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3890751-aa97-4d05-9458-8abdac01aedb tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:26.967305 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3890751-aa97-4d05-9458-8abdac01aedb tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:26.978021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c3890751-aa97-4d05-9458-8abdac01aedb tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1504 microversion: 2.1 time: 0.207338 Jul 04 05:56:26.980249 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 145/307] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:26 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:27.032815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5d4fed67-1a3c-433e-9873-2c51ccb1a07c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:27.033639 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5d4fed67-1a3c-433e-9873-2c51ccb1a07c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:27.042116 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d4fed67-1a3c-433e-9873-2c51ccb1a07c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.042743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d4fed67-1a3c-433e-9873-2c51ccb1a07c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.043882 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d4fed67-1a3c-433e-9873-2c51ccb1a07c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.044404 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d4fed67-1a3c-433e-9873-2c51ccb1a07c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.091016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] validate_networks() for [('bce2b5d0-0a48-4248-902a-974ee1810a73', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:56:27.192808 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5d4fed67-1a3c-433e-9873-2c51ccb1a07c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:27.203713 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5d4fed67-1a3c-433e-9873-2c51ccb1a07c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:27.205676 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5d4fed67-1a3c-433e-9873-2c51ccb1a07c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:27.208228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5d4fed67-1a3c-433e-9873-2c51ccb1a07c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1738 microversion: 2.20 time: 0.179774 Jul 04 05:56:27.220595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 146/308] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:27 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:27.227848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-3ef06da2-b904-4982-a525-da0e8451fef0 req-07512a1d-ce98-4cc2-af3c-49e87ceb1ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6a82fd-4ec7-4019-97b0-bda931a3b48d", "name": "network-vif-deleted", "tag": "b2717eda-04d8-4f3b-9fe7-7ec276183cc0"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:27.238048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-3ef06da2-b904-4982-a525-da0e8451fef0 req-07512a1d-ce98-4cc2-af3c-49e87ceb1ee7 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.238688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-3ef06da2-b904-4982-a525-da0e8451fef0 req-07512a1d-ce98-4cc2-af3c-49e87ceb1ee7 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.251747 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-3ef06da2-b904-4982-a525-da0e8451fef0 req-07512a1d-ce98-4cc2-af3c-49e87ceb1ee7 service nova] Creating event network-vif-deleted:b2717eda-04d8-4f3b-9fe7-7ec276183cc0 for instance 4f6a82fd-4ec7-4019-97b0-bda931a3b48d on hv-cinder-79733 Jul 04 05:56:27.257280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-3ef06da2-b904-4982-a525-da0e8451fef0 req-07512a1d-ce98-4cc2-af3c-49e87ceb1ee7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033925 Jul 04 05:56:27.257888 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 147/309] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:56:27.264760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ffd6075a-ccdf-424e-ad29-5d0de669e5e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:27.265458 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ffd6075a-ccdf-424e-ad29-5d0de669e5e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:27.271896 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffd6075a-ccdf-424e-ad29-5d0de669e5e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.272346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffd6075a-ccdf-424e-ad29-5d0de669e5e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.273120 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffd6075a-ccdf-424e-ad29-5d0de669e5e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.277686 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffd6075a-ccdf-424e-ad29-5d0de669e5e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.425145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ffd6075a-ccdf-424e-ad29-5d0de669e5e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:27.432970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ffd6075a-ccdf-424e-ad29-5d0de669e5e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.173726 Jul 04 05:56:27.433680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 148/310] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:27 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:27.465318 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-41057595-2916-4c51-bf86-1cdeea14a579 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:27.466011 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-41057595-2916-4c51-bf86-1cdeea14a579 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:27.472410 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41057595-2916-4c51-bf86-1cdeea14a579 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.472862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41057595-2916-4c51-bf86-1cdeea14a579 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.473664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41057595-2916-4c51-bf86-1cdeea14a579 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.474096 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41057595-2916-4c51-bf86-1cdeea14a579 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.524305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:56:27.524981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:56:27.525473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:56:27.526068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:56:27.526430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:56:27.539164 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.539908 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.541234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.541678 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.560599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Getting quotas for project b3ee0596be3b4648bd859293e02b1944. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:56:27.565081 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Getting quotas for user e78b454f9d0b4e99ae0425cd596f02c0 and project b3ee0596be3b4648bd859293e02b1944. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:56:27.576428 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:56:27.579280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:56:27.615964 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-41057595-2916-4c51-bf86-1cdeea14a579 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:27.627412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-41057595-2916-4c51-bf86-1cdeea14a579 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.165871 Jul 04 05:56:27.635411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 149/311] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:27 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:27.641412 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c7d4e287-4cfe-4e3a-b26b-d021dfcdc29f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.185831 Jul 04 05:56:27.642044 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 163/312] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:56:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:56:27.653406 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0124fe5e-c887-4a19-840e-c78fd59bbd1e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:27.654102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0124fe5e-c887-4a19-840e-c78fd59bbd1e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:27.711232 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0124fe5e-c887-4a19-840e-c78fd59bbd1e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:27.719000 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0124fe5e-c887-4a19-840e-c78fd59bbd1e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1219 microversion: 2.1 time: 0.070623 Jul 04 05:56:27.719605 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 150/313] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:27 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:27.754985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3f94984b-1090-442d-a60c-be06d6b1f0c4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:27.761236 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f94984b-1090-442d-a60c-be06d6b1f0c4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.761664 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f94984b-1090-442d-a60c-be06d6b1f0c4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.827400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3f94984b-1090-442d-a60c-be06d6b1f0c4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Going to try to stop instance {{(pid=117607) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 05:56:27.876685 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3f94984b-1090-442d-a60c-be06d6b1f0c4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "POST /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/action" status: 202 len: 0 microversion: 2.1 time: 0.125623 Jul 04 05:56:27.880757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 164/314] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 05:56:27 2022] POST /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:56:27.886171 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-694dbc2f-504c-4306-bf61-e918f993bc57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:27.887595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-694dbc2f-504c-4306-bf61-e918f993bc57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:27.894715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-694dbc2f-504c-4306-bf61-e918f993bc57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.895081 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-694dbc2f-504c-4306-bf61-e918f993bc57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.895878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-694dbc2f-504c-4306-bf61-e918f993bc57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:27.896310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-694dbc2f-504c-4306-bf61-e918f993bc57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:27.997463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a4923b8f-e0af-4fca-83a1-a045105bce67 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:27.998167 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a4923b8f-e0af-4fca-83a1-a045105bce67 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:28.005809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4923b8f-e0af-4fca-83a1-a045105bce67 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:28.006289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4923b8f-e0af-4fca-83a1-a045105bce67 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:28.007073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4923b8f-e0af-4fca-83a1-a045105bce67 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:28.007750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4923b8f-e0af-4fca-83a1-a045105bce67 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:28.040856 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-694dbc2f-504c-4306-bf61-e918f993bc57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:28.046567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4923b8f-e0af-4fca-83a1-a045105bce67 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:28.047013 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4923b8f-e0af-4fca-83a1-a045105bce67 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:28.047484 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-a4923b8f-e0af-4fca-83a1-a045105bce67 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lazy-loading 'fault' on Instance uuid 4f6a82fd-4ec7-4019-97b0-bda931a3b48d {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:56:28.050888 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-694dbc2f-504c-4306-bf61-e918f993bc57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.168775 Jul 04 05:56:28.051585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 151/315] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:27 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:28.092353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a4923b8f-e0af-4fca-83a1-a045105bce67 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:28.100019 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a4923b8f-e0af-4fca-83a1-a045105bce67 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1303 microversion: 2.1 time: 0.107038 Jul 04 05:56:28.100547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 165/316] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:27 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:28.231066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a5680f81-7bf9-45c9-9ac7-6aea0c375933 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:28.231900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a5680f81-7bf9-45c9-9ac7-6aea0c375933 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:28.240021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5680f81-7bf9-45c9-9ac7-6aea0c375933 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:28.240464 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5680f81-7bf9-45c9-9ac7-6aea0c375933 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:28.241232 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5680f81-7bf9-45c9-9ac7-6aea0c375933 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:28.241677 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5680f81-7bf9-45c9-9ac7-6aea0c375933 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:28.387982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a5680f81-7bf9-45c9-9ac7-6aea0c375933 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:28.396044 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a5680f81-7bf9-45c9-9ac7-6aea0c375933 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:28.397755 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a5680f81-7bf9-45c9-9ac7-6aea0c375933 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:28.399819 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a5680f81-7bf9-45c9-9ac7-6aea0c375933 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1738 microversion: 2.20 time: 0.174263 Jul 04 05:56:28.406449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 152/317] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:28 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:28.450169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b0484f81-e48b-4c94-b7b6-9bbdda317aaf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:28.450769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b0484f81-e48b-4c94-b7b6-9bbdda317aaf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:28.459388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0484f81-e48b-4c94-b7b6-9bbdda317aaf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:28.459829 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0484f81-e48b-4c94-b7b6-9bbdda317aaf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:28.460599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0484f81-e48b-4c94-b7b6-9bbdda317aaf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:28.461029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0484f81-e48b-4c94-b7b6-9bbdda317aaf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:28.607359 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b0484f81-e48b-4c94-b7b6-9bbdda317aaf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:28.615109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b0484f81-e48b-4c94-b7b6-9bbdda317aaf tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1366 microversion: 2.1 time: 0.168859 Jul 04 05:56:28.615718 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 166/318] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:28 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:28.644768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4dcc5c3-4c17-4450-981c-099ef9312751 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:28.645377 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c4dcc5c3-4c17-4450-981c-099ef9312751 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:28.651800 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4dcc5c3-4c17-4450-981c-099ef9312751 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:28.652228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4dcc5c3-4c17-4450-981c-099ef9312751 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:28.652994 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4dcc5c3-4c17-4450-981c-099ef9312751 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:28.653431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4dcc5c3-4c17-4450-981c-099ef9312751 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:28.736608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4ac0dbbb-f72f-42f4-a782-67de60a165f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:28.737231 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4ac0dbbb-f72f-42f4-a782-67de60a165f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:28.747974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ac0dbbb-f72f-42f4-a782-67de60a165f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:28.748426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ac0dbbb-f72f-42f4-a782-67de60a165f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:28.749207 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ac0dbbb-f72f-42f4-a782-67de60a165f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:28.749645 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ac0dbbb-f72f-42f4-a782-67de60a165f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:28.787630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c4dcc5c3-4c17-4450-981c-099ef9312751 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:28.795115 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c4dcc5c3-4c17-4450-981c-099ef9312751 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.154619 Jul 04 05:56:28.795945 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 153/319] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:28 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:28.821166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4ac0dbbb-f72f-42f4-a782-67de60a165f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:28.829039 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4ac0dbbb-f72f-42f4-a782-67de60a165f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1223 microversion: 2.1 time: 0.096552 Jul 04 05:56:28.829601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 167/320] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:28 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:29.068971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-085b1a21-5b91-45ef-b282-ebe036078352 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:29.069593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-085b1a21-5b91-45ef-b282-ebe036078352 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:29.076500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-085b1a21-5b91-45ef-b282-ebe036078352 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.076930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-085b1a21-5b91-45ef-b282-ebe036078352 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.077701 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-085b1a21-5b91-45ef-b282-ebe036078352 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.078126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-085b1a21-5b91-45ef-b282-ebe036078352 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.117469 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-39785822-e951-4031-a176-b6efb69e4e0d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:29.118099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-39785822-e951-4031-a176-b6efb69e4e0d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:29.124682 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39785822-e951-4031-a176-b6efb69e4e0d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.125278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39785822-e951-4031-a176-b6efb69e4e0d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.126011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39785822-e951-4031-a176-b6efb69e4e0d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.126443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39785822-e951-4031-a176-b6efb69e4e0d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.156453 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:29.163284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39785822-e951-4031-a176-b6efb69e4e0d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.163897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39785822-e951-4031-a176-b6efb69e4e0d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.164606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-39785822-e951-4031-a176-b6efb69e4e0d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lazy-loading 'fault' on Instance uuid 4f6a82fd-4ec7-4019-97b0-bda931a3b48d {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:56:29.220389 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-39785822-e951-4031-a176-b6efb69e4e0d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:29.229944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-39785822-e951-4031-a176-b6efb69e4e0d tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 200 len: 1303 microversion: 2.1 time: 0.116376 Jul 04 05:56:29.231757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 168/321] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:29 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:29.237231 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-085b1a21-5b91-45ef-b282-ebe036078352 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:29.245669 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-085b1a21-5b91-45ef-b282-ebe036078352 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.180769 Jul 04 05:56:29.246440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 154/322] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:29 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:29.418225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-95b26fe2-e7f5-4b43-863a-488407502f80 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:29.418821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-95b26fe2-e7f5-4b43-863a-488407502f80 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:29.425892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95b26fe2-e7f5-4b43-863a-488407502f80 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.426297 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95b26fe2-e7f5-4b43-863a-488407502f80 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.427102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95b26fe2-e7f5-4b43-863a-488407502f80 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.427567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95b26fe2-e7f5-4b43-863a-488407502f80 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.616545 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-95b26fe2-e7f5-4b43-863a-488407502f80 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:29.625954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-95b26fe2-e7f5-4b43-863a-488407502f80 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:29.627709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-95b26fe2-e7f5-4b43-863a-488407502f80 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:29.629194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-95b26fe2-e7f5-4b43-863a-488407502f80 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1720 microversion: 2.20 time: 0.214900 Jul 04 05:56:29.629735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 169/323] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:29 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:29.632860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a7a2907-f170-45ff-9426-34e7fe4af54b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:29.633527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1a7a2907-f170-45ff-9426-34e7fe4af54b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:29.639871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a7a2907-f170-45ff-9426-34e7fe4af54b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.640333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a7a2907-f170-45ff-9426-34e7fe4af54b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.641135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a7a2907-f170-45ff-9426-34e7fe4af54b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.641623 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a7a2907-f170-45ff-9426-34e7fe4af54b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.786644 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a7a2907-f170-45ff-9426-34e7fe4af54b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:29.799100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a7a2907-f170-45ff-9426-34e7fe4af54b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1555 microversion: 2.1 time: 0.170916 Jul 04 05:56:29.800079 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 155/324] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:29 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:29.812580 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-003de4d6-8511-4a78-a9c1-71810b0c2355 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:29.813234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-003de4d6-8511-4a78-a9c1-71810b0c2355 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:29.815931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-161daa75-af97-4317-8d82-98b09047aa15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:29.816419 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-161daa75-af97-4317-8d82-98b09047aa15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:29.819899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-003de4d6-8511-4a78-a9c1-71810b0c2355 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.820348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-003de4d6-8511-4a78-a9c1-71810b0c2355 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.821123 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-003de4d6-8511-4a78-a9c1-71810b0c2355 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.821555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-003de4d6-8511-4a78-a9c1-71810b0c2355 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.822616 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-161daa75-af97-4317-8d82-98b09047aa15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.823059 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-161daa75-af97-4317-8d82-98b09047aa15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.823915 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-161daa75-af97-4317-8d82-98b09047aa15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.824350 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-161daa75-af97-4317-8d82-98b09047aa15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.903115 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-161daa75-af97-4317-8d82-98b09047aa15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091015 Jul 04 05:56:29.903820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 156/325] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jul 4 05:56:29 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:56:29.908601 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b61a8789-2926-44af-9561-936fa8bba411 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:29.909377 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b61a8789-2926-44af-9561-936fa8bba411 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:29.916686 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b61a8789-2926-44af-9561-936fa8bba411 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.916686 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b61a8789-2926-44af-9561-936fa8bba411 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.917452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b61a8789-2926-44af-9561-936fa8bba411 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:29.917955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b61a8789-2926-44af-9561-936fa8bba411 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:29.966541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-003de4d6-8511-4a78-a9c1-71810b0c2355 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:29.978042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-003de4d6-8511-4a78-a9c1-71810b0c2355 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.169245 Jul 04 05:56:29.978556 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 170/326] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:29 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:29.995693 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b61a8789-2926-44af-9561-936fa8bba411 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:30.003429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b61a8789-2926-44af-9561-936fa8bba411 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1271 microversion: 2.1 time: 0.098524 Jul 04 05:56:30.004020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 157/327] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:29 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:30.249944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a961aae4-d341-415a-9de5-221f14f0b3de tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:30.250509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a961aae4-d341-415a-9de5-221f14f0b3de tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 4f6a82fd-4ec7-4019-97b0-bda931a3b48d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:30.257718 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a961aae4-d341-415a-9de5-221f14f0b3de tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:30.258750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a961aae4-d341-415a-9de5-221f14f0b3de tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:30.259745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a961aae4-d341-415a-9de5-221f14f0b3de tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:30.260329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a961aae4-d341-415a-9de5-221f14f0b3de tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:30.264934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff1117f5-7af5-4dfc-bb70-09c82873c6f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:30.266178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff1117f5-7af5-4dfc-bb70-09c82873c6f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:30.273828 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff1117f5-7af5-4dfc-bb70-09c82873c6f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:30.274855 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff1117f5-7af5-4dfc-bb70-09c82873c6f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:30.275865 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff1117f5-7af5-4dfc-bb70-09c82873c6f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:30.275987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-a961aae4-d341-415a-9de5-221f14f0b3de tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] HTTP exception thrown: Instance 4f6a82fd-4ec7-4019-97b0-bda931a3b48d could not be found. Jul 04 05:56:30.276553 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff1117f5-7af5-4dfc-bb70-09c82873c6f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a961aae4-d341-415a-9de5-221f14f0b3de tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Request method failure captured: Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d HTTP/1.1 Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoDtODDzt9_k36xMxw26K653OomaIui47Eoabcf-psPU8BQVvVDfpQMRl8U0avIX3RlnAgyosfK0pCQDrXxyEky0eG0sQEvKEh7jgur9cfIy1syPkprimYKNapfxul39YOYCcex7RIazXbiQe27u2B_8gJYQnh5LZYol-tMSXz9JaNA Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: ee9a610826bc47b395a26f07ad375965 Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesActionsTest-2134443740 Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:56:30.277824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ee9a610826bc47b395a26f07ad375965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ee9a610826bc47b395a26f07ad375965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ee9a610826bc47b395a26f07ad375965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ee9a610826bc47b395a26f07ad375965"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesActionsTest-2134443740 Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: ee9a610826bc47b395a26f07ad375965 Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesActionsTest-2134443740 Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesActionsTest-2134443740-project Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 9dd9a1603e2340eba37ae8699f40b9f6 Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesActionsTest-2134443740-project Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 4f6a82fd-4ec7-4019-97b0-bda931a3b48d could not be found. Jul 04 05:56:30.279377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '4f6a82fd-4ec7-4019-97b0-bda931a3b48d'} Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6a82fd-4ec7-4019-97b0-bda931a3b48d could not be found. Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:56:30.280268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6a82fd-4ec7-4019-97b0-bda931a3b48d could not be found. Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6a82fd-4ec7-4019-97b0-bda931a3b48d could not be found. Jul 04 05:56:30.281690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:56:30.295987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a961aae4-d341-415a-9de5-221f14f0b3de tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Returning 404 to user: Instance 4f6a82fd-4ec7-4019-97b0-bda931a3b48d could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:56:30.295987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a961aae4-d341-415a-9de5-221f14f0b3de tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d" status: 404 len: 111 microversion: 2.1 time: 0.034874 Jul 04 05:56:30.295987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 171/328] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:30 2022] GET /compute/v2.1/servers/4f6a82fd-4ec7-4019-97b0-bda931a3b48d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:56:30.475883 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1702808143", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "networks": [{"uuid": "cd7f0d58-90b5-46e5-9f5d-74435b61e1de"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:30.592260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] validate_networks() for [('cd7f0d58-90b5-46e5-9f5d-74435b61e1de', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:56:30.675503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ff1117f5-7af5-4dfc-bb70-09c82873c6f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:30.692656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff1117f5-7af5-4dfc-bb70-09c82873c6f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.432319 Jul 04 05:56:30.693587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 158/329] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:30 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:30.701944 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5215b4c9-411b-4028-8152-414a67f83330 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:30.703494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5215b4c9-411b-4028-8152-414a67f83330 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:30.719500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5215b4c9-411b-4028-8152-414a67f83330 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:30.721177 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5215b4c9-411b-4028-8152-414a67f83330 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:30.723715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5215b4c9-411b-4028-8152-414a67f83330 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:30.724388 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5215b4c9-411b-4028-8152-414a67f83330 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:31.165714 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:56:31.166135 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:56:31.166609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:56:31.167017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:56:31.167478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:56:31.177976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:31.178394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:31.179198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:31.179678 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:31.200694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Getting quotas for project ee9a610826bc47b395a26f07ad375965. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:56:31.205700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Getting quotas for user 9dd9a1603e2340eba37ae8699f40b9f6 and project ee9a610826bc47b395a26f07ad375965. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:56:31.217874 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:56:31.220253 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:56:31.269412 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a5a3896-a90b-41fb-bad0-17f960523e37 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806473 Jul 04 05:56:31.271390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 172/330] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:56:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:56:31.276541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-ccf750c7-c391-4792-b2fb-a43ae94b91a0 req-fc2b1d83-9e02-4010-a584-797a588672a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178121f0-a865-467e-a46a-069b621b6d17", "name": "network-vif-unplugged", "status": "completed", "tag": "27020a65-ee8e-4790-a27b-3983dfc85818"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:31.288511 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-ccf750c7-c391-4792-b2fb-a43ae94b91a0 req-fc2b1d83-9e02-4010-a584-797a588672a8 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:31.289025 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-ccf750c7-c391-4792-b2fb-a43ae94b91a0 req-fc2b1d83-9e02-4010-a584-797a588672a8 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:31.294252 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:31.299326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5215b4c9-411b-4028-8152-414a67f83330 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:31.303205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-ccf750c7-c391-4792-b2fb-a43ae94b91a0 req-fc2b1d83-9e02-4010-a584-797a588672a8 service nova] Creating event network-vif-unplugged:27020a65-ee8e-4790-a27b-3983dfc85818 for instance 178121f0-a865-467e-a46a-069b621b6d17 on hv-cinder-79733 Jul 04 05:56:31.309251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-ccf750c7-c391-4792-b2fb-a43ae94b91a0 req-fc2b1d83-9e02-4010-a584-797a588672a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035958 Jul 04 05:56:31.309847 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 173/331] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:56:31.315194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-27aad5c8-8a00-4d54-96e2-8c67a6d46498 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:31.316249 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-27aad5c8-8a00-4d54-96e2-8c67a6d46498 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:31.317200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5215b4c9-411b-4028-8152-414a67f83330 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:31.326587 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27aad5c8-8a00-4d54-96e2-8c67a6d46498 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:31.327037 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27aad5c8-8a00-4d54-96e2-8c67a6d46498 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:31.327992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27aad5c8-8a00-4d54-96e2-8c67a6d46498 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:31.328228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5215b4c9-411b-4028-8152-414a67f83330 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:31.328432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27aad5c8-8a00-4d54-96e2-8c67a6d46498 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:31.330323 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5215b4c9-411b-4028-8152-414a67f83330 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1720 microversion: 2.20 time: 0.634179 Jul 04 05:56:31.332032 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 159/332] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:30 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1720 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:31.338810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4ae7d69-21c1-4224-a6f9-641488971bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:31.339822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c4ae7d69-21c1-4224-a6f9-641488971bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:31.349728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ae7d69-21c1-4224-a6f9-641488971bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:31.350395 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ae7d69-21c1-4224-a6f9-641488971bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:31.351506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ae7d69-21c1-4224-a6f9-641488971bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:31.352138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ae7d69-21c1-4224-a6f9-641488971bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:31.467548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c4ae7d69-21c1-4224-a6f9-641488971bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:31.480427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c4ae7d69-21c1-4224-a6f9-641488971bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1277 microversion: 2.1 time: 0.147024 Jul 04 05:56:31.481551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 160/333] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:31 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:31.487106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a8140908-cb29-4cc3-9915-bfb57213f44e tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:31.487906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a8140908-cb29-4cc3-9915-bfb57213f44e tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:31.580858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-27aad5c8-8a00-4d54-96e2-8c67a6d46498 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:31.590287 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-27aad5c8-8a00-4d54-96e2-8c67a6d46498 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.279292 Jul 04 05:56:31.591189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 174/334] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:31 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:31.648322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a8140908-cb29-4cc3-9915-bfb57213f44e tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:31.656880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a8140908-cb29-4cc3-9915-bfb57213f44e tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1214 microversion: 2.1 time: 0.173437 Jul 04 05:56:31.658082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 161/335] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:31 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:31.710303 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-df22c0dd-2c2b-498b-b08a-eaccf68d7d9d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:31.711022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-df22c0dd-2c2b-498b-b08a-eaccf68d7d9d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:31.717610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df22c0dd-2c2b-498b-b08a-eaccf68d7d9d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:31.718661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df22c0dd-2c2b-498b-b08a-eaccf68d7d9d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:31.719708 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df22c0dd-2c2b-498b-b08a-eaccf68d7d9d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:31.720335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df22c0dd-2c2b-498b-b08a-eaccf68d7d9d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:31.773451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-bee79d93-b44e-4c32-be20-e8fb6daa78e1 req-e45cc0cc-82c5-42a9-9148-74b913fec8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5a689e-ec6d-40f5-beeb-36326b13fb0b", "tag": "be2b55c5-eb0b-48a8-a754-efe9ce27c3a4"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:31.785666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-bee79d93-b44e-4c32-be20-e8fb6daa78e1 req-e45cc0cc-82c5-42a9-9148-74b913fec8a4 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:31.786206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-bee79d93-b44e-4c32-be20-e8fb6daa78e1 req-e45cc0cc-82c5-42a9-9148-74b913fec8a4 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:31.807784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-bee79d93-b44e-4c32-be20-e8fb6daa78e1 req-e45cc0cc-82c5-42a9-9148-74b913fec8a4 service nova] Creating event network-changed:be2b55c5-eb0b-48a8-a754-efe9ce27c3a4 for instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b on hv-cinder-79733 Jul 04 05:56:31.817683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-bee79d93-b44e-4c32-be20-e8fb6daa78e1 req-e45cc0cc-82c5-42a9-9148-74b913fec8a4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048620 Jul 04 05:56:31.819143 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 162/336] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:56:31.899026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df22c0dd-2c2b-498b-b08a-eaccf68d7d9d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:31.908282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-df22c0dd-2c2b-498b-b08a-eaccf68d7d9d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.202145 Jul 04 05:56:31.908809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 175/337] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:31 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:32.351765 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-87800dcd-6f2c-4ef3-981e-3b128bfa95a2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:32.352473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-87800dcd-6f2c-4ef3-981e-3b128bfa95a2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:32.359487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87800dcd-6f2c-4ef3-981e-3b128bfa95a2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:32.359944 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87800dcd-6f2c-4ef3-981e-3b128bfa95a2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:32.360721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87800dcd-6f2c-4ef3-981e-3b128bfa95a2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:32.361339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87800dcd-6f2c-4ef3-981e-3b128bfa95a2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:32.496653 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87800dcd-6f2c-4ef3-981e-3b128bfa95a2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:32.498031 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a2e9736e-e98c-478c-b03c-3190bd464ce4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:32.498650 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a2e9736e-e98c-478c-b03c-3190bd464ce4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:32.501267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:32.505475 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2e9736e-e98c-478c-b03c-3190bd464ce4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:32.506279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2e9736e-e98c-478c-b03c-3190bd464ce4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:32.507000 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87800dcd-6f2c-4ef3-981e-3b128bfa95a2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:32.507616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2e9736e-e98c-478c-b03c-3190bd464ce4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:32.508205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2e9736e-e98c-478c-b03c-3190bd464ce4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:32.508839 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87800dcd-6f2c-4ef3-981e-3b128bfa95a2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:32.510015 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-87800dcd-6f2c-4ef3-981e-3b128bfa95a2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1720 microversion: 2.20 time: 0.162568 Jul 04 05:56:32.510891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 163/338] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:32 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:32.607956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e0e71719-ff76-41b8-bd41-15781d83925c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:32.608503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e0e71719-ff76-41b8-bd41-15781d83925c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:32.615151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0e71719-ff76-41b8-bd41-15781d83925c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:32.615664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0e71719-ff76-41b8-bd41-15781d83925c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:32.616438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0e71719-ff76-41b8-bd41-15781d83925c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:32.616877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0e71719-ff76-41b8-bd41-15781d83925c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:32.641767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a2e9736e-e98c-478c-b03c-3190bd464ce4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:32.653761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a2e9736e-e98c-478c-b03c-3190bd464ce4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.159555 Jul 04 05:56:32.654375 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 176/339] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:32 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:32.674676 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0d3ea55c-15b7-4dee-a550-3eb6cee14c7c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:32.675310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0d3ea55c-15b7-4dee-a550-3eb6cee14c7c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:32.681883 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d3ea55c-15b7-4dee-a550-3eb6cee14c7c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:32.682325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d3ea55c-15b7-4dee-a550-3eb6cee14c7c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:32.683128 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d3ea55c-15b7-4dee-a550-3eb6cee14c7c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:32.683544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d3ea55c-15b7-4dee-a550-3eb6cee14c7c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:32.764169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0d3ea55c-15b7-4dee-a550-3eb6cee14c7c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:32.772313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0d3ea55c-15b7-4dee-a550-3eb6cee14c7c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1218 microversion: 2.1 time: 0.101966 Jul 04 05:56:32.775751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0e71719-ff76-41b8-bd41-15781d83925c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:32.779673 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 177/340] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:32 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:32.783588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e0e71719-ff76-41b8-bd41-15781d83925c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1521 microversion: 2.1 time: 0.179672 Jul 04 05:56:32.784204 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 164/341] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:32 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:32.926224 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f710564b-c48d-4f8b-82b4-3a89260d361f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:32.926721 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f710564b-c48d-4f8b-82b4-3a89260d361f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:32.933907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f710564b-c48d-4f8b-82b4-3a89260d361f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:32.934435 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f710564b-c48d-4f8b-82b4-3a89260d361f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:32.935239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f710564b-c48d-4f8b-82b4-3a89260d361f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:32.935820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f710564b-c48d-4f8b-82b4-3a89260d361f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:33.073184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f710564b-c48d-4f8b-82b4-3a89260d361f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:33.081324 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f710564b-c48d-4f8b-82b4-3a89260d361f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.159213 Jul 04 05:56:33.081949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 178/342] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:32 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:33.528111 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-be82ef1a-5731-4fb7-ad70-674cec7f7f59 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:33.528663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-be82ef1a-5731-4fb7-ad70-674cec7f7f59 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:33.536400 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be82ef1a-5731-4fb7-ad70-674cec7f7f59 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:33.536871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be82ef1a-5731-4fb7-ad70-674cec7f7f59 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:33.537645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be82ef1a-5731-4fb7-ad70-674cec7f7f59 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:33.538079 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be82ef1a-5731-4fb7-ad70-674cec7f7f59 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:33.670185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-046f818d-c068-4993-be5b-8cf59dad7b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:33.671240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-046f818d-c068-4993-be5b-8cf59dad7b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:33.678200 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-046f818d-c068-4993-be5b-8cf59dad7b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:33.678963 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-046f818d-c068-4993-be5b-8cf59dad7b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:33.679951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-046f818d-c068-4993-be5b-8cf59dad7b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:33.680376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-046f818d-c068-4993-be5b-8cf59dad7b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:33.734801 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-be82ef1a-5731-4fb7-ad70-674cec7f7f59 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:33.743956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-be82ef1a-5731-4fb7-ad70-674cec7f7f59 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:33.745429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-be82ef1a-5731-4fb7-ad70-674cec7f7f59 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:33.746712 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-be82ef1a-5731-4fb7-ad70-674cec7f7f59 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1720 microversion: 2.20 time: 0.222696 Jul 04 05:56:33.757595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 165/343] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:33 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:33.791759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bb250894-348d-42fd-b4c6-93afd09456f8 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:33.793096 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bb250894-348d-42fd-b4c6-93afd09456f8 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:33.802111 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb250894-348d-42fd-b4c6-93afd09456f8 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:33.802889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb250894-348d-42fd-b4c6-93afd09456f8 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:33.803868 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb250894-348d-42fd-b4c6-93afd09456f8 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:33.804631 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb250894-348d-42fd-b4c6-93afd09456f8 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:33.836341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-046f818d-c068-4993-be5b-8cf59dad7b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:33.844066 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-046f818d-c068-4993-be5b-8cf59dad7b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.177953 Jul 04 05:56:33.845064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 179/344] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:33 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:33.850900 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4963a0a4-08e5-43c0-ba2e-27ef387ac91f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:33.851657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4963a0a4-08e5-43c0-ba2e-27ef387ac91f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:33.857881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4963a0a4-08e5-43c0-ba2e-27ef387ac91f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:33.858408 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4963a0a4-08e5-43c0-ba2e-27ef387ac91f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:33.859284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4963a0a4-08e5-43c0-ba2e-27ef387ac91f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:33.859776 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4963a0a4-08e5-43c0-ba2e-27ef387ac91f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:33.883680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bb250894-348d-42fd-b4c6-93afd09456f8 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:33.891156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bb250894-348d-42fd-b4c6-93afd09456f8 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1210 microversion: 2.1 time: 0.105262 Jul 04 05:56:33.891946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 166/345] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:33 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:33.990193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4963a0a4-08e5-43c0-ba2e-27ef387ac91f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:33.998186 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4963a0a4-08e5-43c0-ba2e-27ef387ac91f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1501 microversion: 2.1 time: 0.151077 Jul 04 05:56:33.998765 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 180/346] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:33 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:34.014179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1bab762c-5460-4b70-a41e-c740af20fea2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:34.014786 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1bab762c-5460-4b70-a41e-c740af20fea2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:34.021016 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bab762c-5460-4b70-a41e-c740af20fea2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:34.021462 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bab762c-5460-4b70-a41e-c740af20fea2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:34.022216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bab762c-5460-4b70-a41e-c740af20fea2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:34.022615 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bab762c-5460-4b70-a41e-c740af20fea2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:34.098149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ea83f5c-26df-407f-9ca2-e92125a6cc02 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:34.098870 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ea83f5c-26df-407f-9ca2-e92125a6cc02 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:34.105447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ea83f5c-26df-407f-9ca2-e92125a6cc02 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:34.105894 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ea83f5c-26df-407f-9ca2-e92125a6cc02 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:34.106671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ea83f5c-26df-407f-9ca2-e92125a6cc02 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:34.107134 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ea83f5c-26df-407f-9ca2-e92125a6cc02 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:34.241042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1bab762c-5460-4b70-a41e-c740af20fea2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:34.248835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1bab762c-5460-4b70-a41e-c740af20fea2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1512 microversion: 2.1 time: 0.238442 Jul 04 05:56:34.261800 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 167/347] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:34 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:34.329713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ea83f5c-26df-407f-9ca2-e92125a6cc02 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:34.345806 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ea83f5c-26df-407f-9ca2-e92125a6cc02 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.250945 Jul 04 05:56:34.346431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 181/348] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:34 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:34.438066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-6925dc50-7f44-4b2f-b396-115d21356bac req-4557b10d-8088-47a2-a647-ea13e18600ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f46f48-e103-480b-89aa-f3a9b0a01bc8", "tag": "49e7c0bb-a6c5-4be3-a26b-06d3b6936c19"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:34.447341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6925dc50-7f44-4b2f-b396-115d21356bac req-4557b10d-8088-47a2-a647-ea13e18600ae service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:34.447794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6925dc50-7f44-4b2f-b396-115d21356bac req-4557b10d-8088-47a2-a647-ea13e18600ae service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:34.464497 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-6925dc50-7f44-4b2f-b396-115d21356bac req-4557b10d-8088-47a2-a647-ea13e18600ae service nova] Creating event network-changed:49e7c0bb-a6c5-4be3-a26b-06d3b6936c19 for instance 58f46f48-e103-480b-89aa-f3a9b0a01bc8 on hv-cinder-79733 Jul 04 05:56:34.471333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-6925dc50-7f44-4b2f-b396-115d21356bac req-4557b10d-8088-47a2-a647-ea13e18600ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037166 Jul 04 05:56:34.472392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 168/349] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:56:34.765346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a29e005d-a8b3-470a-882b-eaf624806502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:34.766067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a29e005d-a8b3-470a-882b-eaf624806502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:34.772362 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a29e005d-a8b3-470a-882b-eaf624806502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:34.772867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a29e005d-a8b3-470a-882b-eaf624806502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:34.773624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a29e005d-a8b3-470a-882b-eaf624806502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:34.774050 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a29e005d-a8b3-470a-882b-eaf624806502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:34.861943 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bc31750d-a874-41b7-ae88-8f717feeee81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:34.862646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bc31750d-a874-41b7-ae88-8f717feeee81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:34.870193 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc31750d-a874-41b7-ae88-8f717feeee81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:34.870889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc31750d-a874-41b7-ae88-8f717feeee81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:34.871790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc31750d-a874-41b7-ae88-8f717feeee81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:34.872956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc31750d-a874-41b7-ae88-8f717feeee81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:34.910299 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a29e005d-a8b3-470a-882b-eaf624806502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:34.918720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a29e005d-a8b3-470a-882b-eaf624806502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:34.920370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a29e005d-a8b3-470a-882b-eaf624806502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:34.921966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a29e005d-a8b3-470a-882b-eaf624806502 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1663 microversion: 2.20 time: 0.160677 Jul 04 05:56:34.922453 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 182/350] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:34 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:34.927965 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d2552f69-edc0-406e-88ca-b3f72fa404ea tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:34.928757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d2552f69-edc0-406e-88ca-b3f72fa404ea tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:34.937376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2552f69-edc0-406e-88ca-b3f72fa404ea tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:34.937818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2552f69-edc0-406e-88ca-b3f72fa404ea tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:34.938785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2552f69-edc0-406e-88ca-b3f72fa404ea tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:34.939218 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2552f69-edc0-406e-88ca-b3f72fa404ea tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.000863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d2552f69-edc0-406e-88ca-b3f72fa404ea tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:35.008419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d2552f69-edc0-406e-88ca-b3f72fa404ea tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1266 microversion: 2.1 time: 0.084796 Jul 04 05:56:35.009225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 183/351] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:34 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:35.013770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-17617c3f-7a04-404c-959d-ae76cdcadb85 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0caf326e-261a-48c4-a5c7-c3206bbf3442"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:35.014884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-17617c3f-7a04-404c-959d-ae76cdcadb85 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:35.017780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bc31750d-a874-41b7-ae88-8f717feeee81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:35.020903 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17617c3f-7a04-404c-959d-ae76cdcadb85 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.021356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17617c3f-7a04-404c-959d-ae76cdcadb85 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.022119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17617c3f-7a04-404c-959d-ae76cdcadb85 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.022551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17617c3f-7a04-404c-959d-ae76cdcadb85 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.025343 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bc31750d-a874-41b7-ae88-8f717feeee81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.167588 Jul 04 05:56:35.025907 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 169/352] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:34 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:35.371601 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-70494487-22d8-4974-986b-2c89b23b1a92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:35.372484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-70494487-22d8-4974-986b-2c89b23b1a92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:35.384745 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:35.388656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70494487-22d8-4974-986b-2c89b23b1a92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.389179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70494487-22d8-4974-986b-2c89b23b1a92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.389922 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-17617c3f-7a04-404c-959d-ae76cdcadb85 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "POST /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.379670 Jul 04 05:56:35.390049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70494487-22d8-4974-986b-2c89b23b1a92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.390548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70494487-22d8-4974-986b-2c89b23b1a92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.391221 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 184/353] 10.222.0.42 () {62 vars in 1363 bytes} [Mon Jul 4 05:56:35 2022] POST /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-volume_attachments => generated 188 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:56:35.529742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c09b9528-bd92-48b8-97ae-ccc5df43dadd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:35.530309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c09b9528-bd92-48b8-97ae-ccc5df43dadd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:35.538714 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c09b9528-bd92-48b8-97ae-ccc5df43dadd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.539162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c09b9528-bd92-48b8-97ae-ccc5df43dadd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.539968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c09b9528-bd92-48b8-97ae-ccc5df43dadd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.540857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c09b9528-bd92-48b8-97ae-ccc5df43dadd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.626653 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-70494487-22d8-4974-986b-2c89b23b1a92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:35.644197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-70494487-22d8-4974-986b-2c89b23b1a92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.284061 Jul 04 05:56:35.656118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 170/354] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:35 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:35.691170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c09b9528-bd92-48b8-97ae-ccc5df43dadd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "POST /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/action" status: 202 len: 0 microversion: 2.20 time: 0.165281 Jul 04 05:56:35.692323 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 185/355] 10.222.0.42 () {62 vars in 1318 bytes} [Mon Jul 4 05:56:35 2022] POST /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 04 05:56:35.697375 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f890deab-4698-43c7-a5e8-b5edbaa422ae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:35.698444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f890deab-4698-43c7-a5e8-b5edbaa422ae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:35.701169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-37feec20-ea01-42ed-99e5-b19234986753 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:35.702067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-37feec20-ea01-42ed-99e5-b19234986753 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:35.705134 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f890deab-4698-43c7-a5e8-b5edbaa422ae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.706605 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f890deab-4698-43c7-a5e8-b5edbaa422ae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.707938 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f890deab-4698-43c7-a5e8-b5edbaa422ae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.708439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f890deab-4698-43c7-a5e8-b5edbaa422ae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.711552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37feec20-ea01-42ed-99e5-b19234986753 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.712274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37feec20-ea01-42ed-99e5-b19234986753 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.713410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37feec20-ea01-42ed-99e5-b19234986753 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.714054 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37feec20-ea01-42ed-99e5-b19234986753 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.743270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-f890deab-4698-43c7-a5e8-b5edbaa422ae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lazy-loading 'flavor' on Instance uuid b315f101-8d5d-4b0a-994f-f5c7235ddac6 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:56:35.852720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f890deab-4698-43c7-a5e8-b5edbaa422ae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6/action" status: 200 len: 32 microversion: 2.1 time: 0.162625 Jul 04 05:56:35.853984 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 171/356] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 05:56:35 2022] POST /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 04 05:56:35.863378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5cc5523f-cc92-4fce-8009-cca5ad2fd7b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:35.864084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5cc5523f-cc92-4fce-8009-cca5ad2fd7b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:35.872221 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5cc5523f-cc92-4fce-8009-cca5ad2fd7b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.872916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5cc5523f-cc92-4fce-8009-cca5ad2fd7b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:35.873914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5cc5523f-cc92-4fce-8009-cca5ad2fd7b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:35.874510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5cc5523f-cc92-4fce-8009-cca5ad2fd7b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:36.000548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-37feec20-ea01-42ed-99e5-b19234986753 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:36.007875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:36.011203 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-37feec20-ea01-42ed-99e5-b19234986753 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:36.012730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-37feec20-ea01-42ed-99e5-b19234986753 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:36.013901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-37feec20-ea01-42ed-99e5-b19234986753 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1749 microversion: 2.20 time: 0.317746 Jul 04 05:56:36.014970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 186/357] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:35 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1749 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:36.030985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-487cd02a-a13b-40a8-a73c-1cc6eeba94b4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:36.032902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-487cd02a-a13b-40a8-a73c-1cc6eeba94b4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:36.042490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-487cd02a-a13b-40a8-a73c-1cc6eeba94b4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:36.043417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-487cd02a-a13b-40a8-a73c-1cc6eeba94b4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:36.044963 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-487cd02a-a13b-40a8-a73c-1cc6eeba94b4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:36.045695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-487cd02a-a13b-40a8-a73c-1cc6eeba94b4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:36.160320 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-487cd02a-a13b-40a8-a73c-1cc6eeba94b4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:36.168170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-487cd02a-a13b-40a8-a73c-1cc6eeba94b4 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1272 microversion: 2.1 time: 0.141211 Jul 04 05:56:36.178563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 187/358] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:36 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:36.184620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9b8e6b4-da4d-4693-a408-1595ab94ac06 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:36.185299 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c9b8e6b4-da4d-4693-a408-1595ab94ac06 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:36.197113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9b8e6b4-da4d-4693-a408-1595ab94ac06 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:36.198368 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9b8e6b4-da4d-4693-a408-1595ab94ac06 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:36.199896 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9b8e6b4-da4d-4693-a408-1595ab94ac06 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:36.200785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9b8e6b4-da4d-4693-a408-1595ab94ac06 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:36.425362 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5cc5523f-cc92-4fce-8009-cca5ad2fd7b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:36.438783 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5cc5523f-cc92-4fce-8009-cca5ad2fd7b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.579636 Jul 04 05:56:36.449236 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 172/359] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:35 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:36.600006 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c9b8e6b4-da4d-4693-a408-1595ab94ac06 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:36.608091 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c9b8e6b4-da4d-4693-a408-1595ab94ac06 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.428432 Jul 04 05:56:36.608719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 188/360] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:36 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:36.663429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-852aed7f-baf8-4217-9c82-f57ac58c6a4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:36.664037 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-852aed7f-baf8-4217-9c82-f57ac58c6a4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:36.670104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-852aed7f-baf8-4217-9c82-f57ac58c6a4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:36.670551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-852aed7f-baf8-4217-9c82-f57ac58c6a4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:36.671705 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-852aed7f-baf8-4217-9c82-f57ac58c6a4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:36.672138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-852aed7f-baf8-4217-9c82-f57ac58c6a4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:36.804915 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-852aed7f-baf8-4217-9c82-f57ac58c6a4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:36.813460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-852aed7f-baf8-4217-9c82-f57ac58c6a4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.153821 Jul 04 05:56:36.814025 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 173/361] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:36 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:37.032709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0f8d7a84-b769-4e7f-816d-f04e0eebbe47 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:37.033365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0f8d7a84-b769-4e7f-816d-f04e0eebbe47 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:37.039910 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f8d7a84-b769-4e7f-816d-f04e0eebbe47 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:37.040411 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f8d7a84-b769-4e7f-816d-f04e0eebbe47 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:37.041770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f8d7a84-b769-4e7f-816d-f04e0eebbe47 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:37.042296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f8d7a84-b769-4e7f-816d-f04e0eebbe47 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:37.177309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0f8d7a84-b769-4e7f-816d-f04e0eebbe47 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:37.185691 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dc9333d6-5e23-444a-9091-882ea3ac7e89 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:37.186299 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dc9333d6-5e23-444a-9091-882ea3ac7e89 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:37.188569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0f8d7a84-b769-4e7f-816d-f04e0eebbe47 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:37.190409 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0f8d7a84-b769-4e7f-816d-f04e0eebbe47 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:37.191632 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0f8d7a84-b769-4e7f-816d-f04e0eebbe47 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1749 microversion: 2.20 time: 0.163975 Jul 04 05:56:37.192565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 189/362] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:37 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:37.193159 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc9333d6-5e23-444a-9091-882ea3ac7e89 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:37.193586 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc9333d6-5e23-444a-9091-882ea3ac7e89 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:37.194386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc9333d6-5e23-444a-9091-882ea3ac7e89 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:37.194818 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc9333d6-5e23-444a-9091-882ea3ac7e89 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:37.331068 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dc9333d6-5e23-444a-9091-882ea3ac7e89 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:37.338885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dc9333d6-5e23-444a-9091-882ea3ac7e89 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.157169 Jul 04 05:56:37.339476 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 174/363] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:37 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:37.459327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e0ad807a-35b5-4d87-9bb2-70ecc79e9a49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:37.460047 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e0ad807a-35b5-4d87-9bb2-70ecc79e9a49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:37.471080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0ad807a-35b5-4d87-9bb2-70ecc79e9a49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:37.473427 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0ad807a-35b5-4d87-9bb2-70ecc79e9a49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:37.476812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0ad807a-35b5-4d87-9bb2-70ecc79e9a49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:37.477824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0ad807a-35b5-4d87-9bb2-70ecc79e9a49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:37.625117 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8212e5f8-a73c-4dd8-8bdc-6a623401904d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:37.626034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8212e5f8-a73c-4dd8-8bdc-6a623401904d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:37.633796 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8212e5f8-a73c-4dd8-8bdc-6a623401904d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:37.634407 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8212e5f8-a73c-4dd8-8bdc-6a623401904d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:37.635344 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8212e5f8-a73c-4dd8-8bdc-6a623401904d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:37.635867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8212e5f8-a73c-4dd8-8bdc-6a623401904d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:37.782346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8212e5f8-a73c-4dd8-8bdc-6a623401904d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:37.790440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8212e5f8-a73c-4dd8-8bdc-6a623401904d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.169652 Jul 04 05:56:37.791021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 175/364] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:37 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:37.831443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-33c95841-5687-4f00-84aa-caacd7181540 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:37.832380 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-33c95841-5687-4f00-84aa-caacd7181540 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:37.838676 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33c95841-5687-4f00-84aa-caacd7181540 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:37.839144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33c95841-5687-4f00-84aa-caacd7181540 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:37.840082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33c95841-5687-4f00-84aa-caacd7181540 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:37.840582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33c95841-5687-4f00-84aa-caacd7181540 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:37.980558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-33c95841-5687-4f00-84aa-caacd7181540 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:37.989461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-33c95841-5687-4f00-84aa-caacd7181540 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.162079 Jul 04 05:56:37.990047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 176/365] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:37 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:38.075506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e0ad807a-35b5-4d87-9bb2-70ecc79e9a49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:38.085102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e0ad807a-35b5-4d87-9bb2-70ecc79e9a49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.632586 Jul 04 05:56:38.085673 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 190/366] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:37 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:38.209700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-715adc4c-5c3e-4530-9646-c9358e7f2b68 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:38.210494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-715adc4c-5c3e-4530-9646-c9358e7f2b68 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:38.216972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-715adc4c-5c3e-4530-9646-c9358e7f2b68 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:38.217421 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-715adc4c-5c3e-4530-9646-c9358e7f2b68 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:38.218192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-715adc4c-5c3e-4530-9646-c9358e7f2b68 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:38.218628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-715adc4c-5c3e-4530-9646-c9358e7f2b68 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:38.355831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9970f051-9ec3-4365-a573-4de724f050cd tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:38.356721 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9970f051-9ec3-4365-a573-4de724f050cd tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:38.363777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9970f051-9ec3-4365-a573-4de724f050cd tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:38.364577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9970f051-9ec3-4365-a573-4de724f050cd tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:38.365569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9970f051-9ec3-4365-a573-4de724f050cd tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:38.366259 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9970f051-9ec3-4365-a573-4de724f050cd tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:38.373024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-715adc4c-5c3e-4530-9646-c9358e7f2b68 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:38.385087 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-715adc4c-5c3e-4530-9646-c9358e7f2b68 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:38.387383 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-715adc4c-5c3e-4530-9646-c9358e7f2b68 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:38.389179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-715adc4c-5c3e-4530-9646-c9358e7f2b68 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1751 microversion: 2.20 time: 0.183382 Jul 04 05:56:38.389743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 177/367] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:38 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:38.584391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9970f051-9ec3-4365-a573-4de724f050cd tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:38.593758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9970f051-9ec3-4365-a573-4de724f050cd tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.241994 Jul 04 05:56:38.597239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 191/368] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:38 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:38.630247 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-b723767d-0e8f-4d3f-b46d-df3b85168da0 req-8e9d73e9-2ecd-445d-9253-0cc2c3a8f0cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf08277-34bd-4abc-b791-020400737f7e", "tag": "cbf83c6a-9b07-4cfd-b772-2de8a2a1b628"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:38.651198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-b723767d-0e8f-4d3f-b46d-df3b85168da0 req-8e9d73e9-2ecd-445d-9253-0cc2c3a8f0cd service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:38.651680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-b723767d-0e8f-4d3f-b46d-df3b85168da0 req-8e9d73e9-2ecd-445d-9253-0cc2c3a8f0cd service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:38.663648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-b723767d-0e8f-4d3f-b46d-df3b85168da0 req-8e9d73e9-2ecd-445d-9253-0cc2c3a8f0cd service nova] Creating event network-changed:cbf83c6a-9b07-4cfd-b772-2de8a2a1b628 for instance 6bf08277-34bd-4abc-b791-020400737f7e on hv-cinder-79733 Jul 04 05:56:38.668744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-b723767d-0e8f-4d3f-b46d-df3b85168da0 req-8e9d73e9-2ecd-445d-9253-0cc2c3a8f0cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042162 Jul 04 05:56:38.669681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 178/369] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:56:38.809138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c58e61fa-d56f-478f-b9ad-9c592b5eb987 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:38.810468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c58e61fa-d56f-478f-b9ad-9c592b5eb987 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:38.820756 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c58e61fa-d56f-478f-b9ad-9c592b5eb987 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:38.821322 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c58e61fa-d56f-478f-b9ad-9c592b5eb987 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:38.822300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c58e61fa-d56f-478f-b9ad-9c592b5eb987 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:38.823059 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c58e61fa-d56f-478f-b9ad-9c592b5eb987 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:39.006802 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bd96c436-3ae8-4b99-b5f2-a054af62ee8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:39.007635 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bd96c436-3ae8-4b99-b5f2-a054af62ee8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:39.014577 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd96c436-3ae8-4b99-b5f2-a054af62ee8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:39.015135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd96c436-3ae8-4b99-b5f2-a054af62ee8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:39.016155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd96c436-3ae8-4b99-b5f2-a054af62ee8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:39.016589 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd96c436-3ae8-4b99-b5f2-a054af62ee8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:39.154473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bd96c436-3ae8-4b99-b5f2-a054af62ee8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:39.158918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:39.165331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c58e61fa-d56f-478f-b9ad-9c592b5eb987 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:39.174788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c58e61fa-d56f-478f-b9ad-9c592b5eb987 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.369722 Jul 04 05:56:39.179462 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bd96c436-3ae8-4b99-b5f2-a054af62ee8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.176960 Jul 04 05:56:39.180072 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 192/370] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:38 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:39.185182 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 179/371] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:39 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:39.194340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0f9513b-a20f-426a-982e-3b2ff0b604ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:39.194340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0f9513b-a20f-426a-982e-3b2ff0b604ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:39.200220 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0f9513b-a20f-426a-982e-3b2ff0b604ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:39.200897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0f9513b-a20f-426a-982e-3b2ff0b604ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:39.201665 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0f9513b-a20f-426a-982e-3b2ff0b604ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:39.202093 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0f9513b-a20f-426a-982e-3b2ff0b604ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:39.408109 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-957e110a-bc8a-4913-8705-027ef113dc6a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:39.408811 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-957e110a-bc8a-4913-8705-027ef113dc6a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:39.416514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-957e110a-bc8a-4913-8705-027ef113dc6a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:39.416960 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-957e110a-bc8a-4913-8705-027ef113dc6a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:39.417741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-957e110a-bc8a-4913-8705-027ef113dc6a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:39.418173 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-957e110a-bc8a-4913-8705-027ef113dc6a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:39.447032 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f0f9513b-a20f-426a-982e-3b2ff0b604ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:39.455134 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0f9513b-a20f-426a-982e-3b2ff0b604ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.273491 Jul 04 05:56:39.458698 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 193/372] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:39 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:39.555744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-957e110a-bc8a-4913-8705-027ef113dc6a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:39.564351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-957e110a-bc8a-4913-8705-027ef113dc6a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:39.565751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-957e110a-bc8a-4913-8705-027ef113dc6a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:39.566905 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-957e110a-bc8a-4913-8705-027ef113dc6a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.162839 Jul 04 05:56:39.567516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 180/373] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:39 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:39.613566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-77693e29-286a-41af-8bff-d9975522ddf3 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:39.614176 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-77693e29-286a-41af-8bff-d9975522ddf3 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:39.620486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77693e29-286a-41af-8bff-d9975522ddf3 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:39.620932 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77693e29-286a-41af-8bff-d9975522ddf3 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:39.621692 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77693e29-286a-41af-8bff-d9975522ddf3 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:39.622122 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77693e29-286a-41af-8bff-d9975522ddf3 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:39.941083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-77693e29-286a-41af-8bff-d9975522ddf3 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:39.950361 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-77693e29-286a-41af-8bff-d9975522ddf3 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.340705 Jul 04 05:56:39.960137 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 194/374] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:39 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:40.191589 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-98a308c2-53f5-4236-a125-85d06aea6717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:40.192243 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-98a308c2-53f5-4236-a125-85d06aea6717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:40.198523 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98a308c2-53f5-4236-a125-85d06aea6717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:40.198876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98a308c2-53f5-4236-a125-85d06aea6717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:40.199683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98a308c2-53f5-4236-a125-85d06aea6717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:40.200136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98a308c2-53f5-4236-a125-85d06aea6717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:40.202532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f2984b0b-d034-49b1-a2a0-4286bd8b7827 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:40.203818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f2984b0b-d034-49b1-a2a0-4286bd8b7827 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:40.210296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2984b0b-d034-49b1-a2a0-4286bd8b7827 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:40.210901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2984b0b-d034-49b1-a2a0-4286bd8b7827 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:40.212034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2984b0b-d034-49b1-a2a0-4286bd8b7827 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:40.212712 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2984b0b-d034-49b1-a2a0-4286bd8b7827 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:40.338017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-98a308c2-53f5-4236-a125-85d06aea6717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:40.345351 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f2984b0b-d034-49b1-a2a0-4286bd8b7827 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:40.346100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-98a308c2-53f5-4236-a125-85d06aea6717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.158547 Jul 04 05:56:40.346687 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 181/375] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:40 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:40.353515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f2984b0b-d034-49b1-a2a0-4286bd8b7827 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.155303 Jul 04 05:56:40.354107 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 195/376] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:40 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:40.475780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-89b9722e-f4bd-4318-80ca-d3068a1f5a6d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:40.476484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-89b9722e-f4bd-4318-80ca-d3068a1f5a6d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:40.484337 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89b9722e-f4bd-4318-80ca-d3068a1f5a6d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:40.484858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89b9722e-f4bd-4318-80ca-d3068a1f5a6d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:40.485660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89b9722e-f4bd-4318-80ca-d3068a1f5a6d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:40.486085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89b9722e-f4bd-4318-80ca-d3068a1f5a6d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:40.584754 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-de91cec4-c6ca-40e1-84fa-693ceb178a07 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:40.585363 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-de91cec4-c6ca-40e1-84fa-693ceb178a07 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:40.592384 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de91cec4-c6ca-40e1-84fa-693ceb178a07 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:40.592821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de91cec4-c6ca-40e1-84fa-693ceb178a07 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:40.593766 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de91cec4-c6ca-40e1-84fa-693ceb178a07 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:40.594382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de91cec4-c6ca-40e1-84fa-693ceb178a07 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:40.627151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-89b9722e-f4bd-4318-80ca-d3068a1f5a6d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:40.635747 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-89b9722e-f4bd-4318-80ca-d3068a1f5a6d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.165392 Jul 04 05:56:40.645765 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 182/377] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:40 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:40.651241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-7cc65c1c-0fc0-4eef-97fb-1e5f9560a775 req-259a4f61-a1bb-405d-b45a-41faa1a4de4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f46f48-e103-480b-89aa-f3a9b0a01bc8", "name": "network-vif-plugged", "status": "completed", "tag": "49e7c0bb-a6c5-4be3-a26b-06d3b6936c19"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:40.661329 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-7cc65c1c-0fc0-4eef-97fb-1e5f9560a775 req-259a4f61-a1bb-405d-b45a-41faa1a4de4c service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:40.662029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-7cc65c1c-0fc0-4eef-97fb-1e5f9560a775 req-259a4f61-a1bb-405d-b45a-41faa1a4de4c service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:40.675610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-7cc65c1c-0fc0-4eef-97fb-1e5f9560a775 req-259a4f61-a1bb-405d-b45a-41faa1a4de4c service nova] Creating event network-vif-plugged:49e7c0bb-a6c5-4be3-a26b-06d3b6936c19 for instance 58f46f48-e103-480b-89aa-f3a9b0a01bc8 on hv-cinder-79733 Jul 04 05:56:40.681059 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-7cc65c1c-0fc0-4eef-97fb-1e5f9560a775 req-259a4f61-a1bb-405d-b45a-41faa1a4de4c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033834 Jul 04 05:56:40.681752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 183/378] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:56:40.727196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-de91cec4-c6ca-40e1-84fa-693ceb178a07 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:40.735803 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-de91cec4-c6ca-40e1-84fa-693ceb178a07 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:40.737296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-de91cec4-c6ca-40e1-84fa-693ceb178a07 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:40.738452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-de91cec4-c6ca-40e1-84fa-693ceb178a07 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.158009 Jul 04 05:56:40.739614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 196/379] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:40 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:40.974273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b9c18b7-95f2-4cd7-bae4-d63ca897059a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:40.975315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b9c18b7-95f2-4cd7-bae4-d63ca897059a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:40.985766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9c18b7-95f2-4cd7-bae4-d63ca897059a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:40.986512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9c18b7-95f2-4cd7-bae4-d63ca897059a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:40.987831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9c18b7-95f2-4cd7-bae4-d63ca897059a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:40.988562 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9c18b7-95f2-4cd7-bae4-d63ca897059a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:41.165450 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b9c18b7-95f2-4cd7-bae4-d63ca897059a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:41.174064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b9c18b7-95f2-4cd7-bae4-d63ca897059a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.207067 Jul 04 05:56:41.174701 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 184/380] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:40 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:41.365284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e9de4a9b-e20d-464f-be68-6d7b4f7965df tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:41.371785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e9de4a9b-e20d-464f-be68-6d7b4f7965df tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:41.372094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-16fa8ed0-d857-4b83-bef2-3d78563d9466 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:41.372997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-16fa8ed0-d857-4b83-bef2-3d78563d9466 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:41.377394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:41.379101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=12 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:41.383581 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16fa8ed0-d857-4b83-bef2-3d78563d9466 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:41.383916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9de4a9b-e20d-464f-be68-6d7b4f7965df tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:41.384409 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9de4a9b-e20d-464f-be68-6d7b4f7965df tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:41.385164 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16fa8ed0-d857-4b83-bef2-3d78563d9466 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:41.385289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9de4a9b-e20d-464f-be68-6d7b4f7965df tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:41.385654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9de4a9b-e20d-464f-be68-6d7b4f7965df tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:41.386603 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16fa8ed0-d857-4b83-bef2-3d78563d9466 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:41.387263 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16fa8ed0-d857-4b83-bef2-3d78563d9466 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:41.556066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-16fa8ed0-d857-4b83-bef2-3d78563d9466 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:41.566452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-16fa8ed0-d857-4b83-bef2-3d78563d9466 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.199092 Jul 04 05:56:41.576978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 185/381] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:41 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:41.593462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e9de4a9b-e20d-464f-be68-6d7b4f7965df tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:41.602264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e9de4a9b-e20d-464f-be68-6d7b4f7965df tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.242751 Jul 04 05:56:41.608409 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 197/382] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:41 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:41.655854 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-113f1236-1833-483e-9415-7ca4afaa7d5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:41.657302 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-113f1236-1833-483e-9415-7ca4afaa7d5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:41.681395 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:41.697292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-113f1236-1833-483e-9415-7ca4afaa7d5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:41.698321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-113f1236-1833-483e-9415-7ca4afaa7d5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:41.702688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-113f1236-1833-483e-9415-7ca4afaa7d5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:41.704432 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-113f1236-1833-483e-9415-7ca4afaa7d5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:41.756888 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2e406452-15ea-44ff-85bd-f3e4fd944a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:41.757506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2e406452-15ea-44ff-85bd-f3e4fd944a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:41.764305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e406452-15ea-44ff-85bd-f3e4fd944a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:41.765020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e406452-15ea-44ff-85bd-f3e4fd944a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:41.766022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e406452-15ea-44ff-85bd-f3e4fd944a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:41.766464 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e406452-15ea-44ff-85bd-f3e4fd944a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:41.885653 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-113f1236-1833-483e-9415-7ca4afaa7d5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:41.894099 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-113f1236-1833-483e-9415-7ca4afaa7d5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.244354 Jul 04 05:56:41.903961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 186/383] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:41 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:41.924556 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2e406452-15ea-44ff-85bd-f3e4fd944a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:41.938082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2e406452-15ea-44ff-85bd-f3e4fd944a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:41.939844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2e406452-15ea-44ff-85bd-f3e4fd944a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:41.941010 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2e406452-15ea-44ff-85bd-f3e4fd944a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.188441 Jul 04 05:56:41.941598 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 198/384] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:41 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:42.195536 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2fa8e717-53c9-4b1c-b582-d9dd332110be tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:42.196263 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2fa8e717-53c9-4b1c-b582-d9dd332110be tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:42.202840 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fa8e717-53c9-4b1c-b582-d9dd332110be tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:42.203319 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fa8e717-53c9-4b1c-b582-d9dd332110be tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:42.204248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fa8e717-53c9-4b1c-b582-d9dd332110be tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:42.205358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fa8e717-53c9-4b1c-b582-d9dd332110be tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:42.404610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2fa8e717-53c9-4b1c-b582-d9dd332110be tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:42.422332 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2fa8e717-53c9-4b1c-b582-d9dd332110be tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.231309 Jul 04 05:56:42.427391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 187/385] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:42 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:42.584666 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-efa808c1-8177-4674-a81c-077bb6d2fa2d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:42.585499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-efa808c1-8177-4674-a81c-077bb6d2fa2d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:42.605626 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efa808c1-8177-4674-a81c-077bb6d2fa2d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:42.606245 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efa808c1-8177-4674-a81c-077bb6d2fa2d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:42.607932 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efa808c1-8177-4674-a81c-077bb6d2fa2d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:42.607932 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efa808c1-8177-4674-a81c-077bb6d2fa2d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:42.625541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b0450d7-6d62-4b9e-8187-5fd201ea6a94 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:42.627093 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b0450d7-6d62-4b9e-8187-5fd201ea6a94 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:42.638181 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b0450d7-6d62-4b9e-8187-5fd201ea6a94 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:42.638730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b0450d7-6d62-4b9e-8187-5fd201ea6a94 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:42.639869 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b0450d7-6d62-4b9e-8187-5fd201ea6a94 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:42.640342 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b0450d7-6d62-4b9e-8187-5fd201ea6a94 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:42.920954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-efa808c1-8177-4674-a81c-077bb6d2fa2d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:42.933015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-efa808c1-8177-4674-a81c-077bb6d2fa2d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.352586 Jul 04 05:56:42.948720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 199/386] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:42 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:42.952182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a62c1ef0-913a-4685-85d0-2cfe02410dc1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:42.952804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a62c1ef0-913a-4685-85d0-2cfe02410dc1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:42.969106 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a62c1ef0-913a-4685-85d0-2cfe02410dc1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:42.969825 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a62c1ef0-913a-4685-85d0-2cfe02410dc1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:42.970996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a62c1ef0-913a-4685-85d0-2cfe02410dc1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:42.971996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a62c1ef0-913a-4685-85d0-2cfe02410dc1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:43.013851 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b0450d7-6d62-4b9e-8187-5fd201ea6a94 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:43.023984 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b0450d7-6d62-4b9e-8187-5fd201ea6a94 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.402204 Jul 04 05:56:43.037515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 188/387] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:42 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:43.044360 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9bd5e27f-9431-4b68-8b69-7f48cc6480ca tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:43.046573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9bd5e27f-9431-4b68-8b69-7f48cc6480ca tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:43.053470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bd5e27f-9431-4b68-8b69-7f48cc6480ca tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:43.054165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bd5e27f-9431-4b68-8b69-7f48cc6480ca tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:43.055613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bd5e27f-9431-4b68-8b69-7f48cc6480ca tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:43.056132 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bd5e27f-9431-4b68-8b69-7f48cc6480ca tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:43.195537 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a62c1ef0-913a-4685-85d0-2cfe02410dc1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:43.206312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a62c1ef0-913a-4685-85d0-2cfe02410dc1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.266413 Jul 04 05:56:43.207024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 200/388] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:42 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:43.320180 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9bd5e27f-9431-4b68-8b69-7f48cc6480ca tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:43.333746 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9bd5e27f-9431-4b68-8b69-7f48cc6480ca tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:43.335789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9bd5e27f-9431-4b68-8b69-7f48cc6480ca tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:43.336658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9bd5e27f-9431-4b68-8b69-7f48cc6480ca tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.297112 Jul 04 05:56:43.337245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 189/389] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:43 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:43.441837 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a8a982d8-c3fa-49b9-924e-3ea02c59e005 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:43.442448 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a8a982d8-c3fa-49b9-924e-3ea02c59e005 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:43.461822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8a982d8-c3fa-49b9-924e-3ea02c59e005 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:43.462490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8a982d8-c3fa-49b9-924e-3ea02c59e005 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:43.463592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8a982d8-c3fa-49b9-924e-3ea02c59e005 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:43.464202 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8a982d8-c3fa-49b9-924e-3ea02c59e005 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:43.636056 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a8a982d8-c3fa-49b9-924e-3ea02c59e005 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:43.644862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a8a982d8-c3fa-49b9-924e-3ea02c59e005 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.206856 Jul 04 05:56:43.645574 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 201/390] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:43 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:43.956275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-add53c3e-8360-4540-ae33-cf1304adcb1d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:43.956884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-add53c3e-8360-4540-ae33-cf1304adcb1d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:43.965419 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-add53c3e-8360-4540-ae33-cf1304adcb1d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:43.966010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-add53c3e-8360-4540-ae33-cf1304adcb1d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:43.966891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-add53c3e-8360-4540-ae33-cf1304adcb1d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:43.971506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-add53c3e-8360-4540-ae33-cf1304adcb1d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:44.042010 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dd594f83-291b-4b22-93b0-ae89dac8b75a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:44.043189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dd594f83-291b-4b22-93b0-ae89dac8b75a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:44.051784 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd594f83-291b-4b22-93b0-ae89dac8b75a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:44.052525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd594f83-291b-4b22-93b0-ae89dac8b75a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:44.053675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd594f83-291b-4b22-93b0-ae89dac8b75a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:44.054356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd594f83-291b-4b22-93b0-ae89dac8b75a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:44.174886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-add53c3e-8360-4540-ae33-cf1304adcb1d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:44.200165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-add53c3e-8360-4540-ae33-cf1304adcb1d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.247838 Jul 04 05:56:44.210043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 190/391] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:43 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:44.228832 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dcd0c492-bbd3-41bd-902e-74a6091cf2a4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:44.232760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dcd0c492-bbd3-41bd-902e-74a6091cf2a4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:44.249018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcd0c492-bbd3-41bd-902e-74a6091cf2a4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:44.249481 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcd0c492-bbd3-41bd-902e-74a6091cf2a4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:44.250276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcd0c492-bbd3-41bd-902e-74a6091cf2a4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:44.250711 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcd0c492-bbd3-41bd-902e-74a6091cf2a4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:44.257532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd594f83-291b-4b22-93b0-ae89dac8b75a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:44.266057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dd594f83-291b-4b22-93b0-ae89dac8b75a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.228177 Jul 04 05:56:44.276941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 202/392] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:44 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:44.355846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cbb6fabc-0e7b-42ab-9b3e-8daedb88e811 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:44.356970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cbb6fabc-0e7b-42ab-9b3e-8daedb88e811 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:44.369592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbb6fabc-0e7b-42ab-9b3e-8daedb88e811 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:44.370049 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbb6fabc-0e7b-42ab-9b3e-8daedb88e811 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:44.370844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbb6fabc-0e7b-42ab-9b3e-8daedb88e811 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:44.371292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cbb6fabc-0e7b-42ab-9b3e-8daedb88e811 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:44.411640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:44.470354 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dcd0c492-bbd3-41bd-902e-74a6091cf2a4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:44.479989 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dcd0c492-bbd3-41bd-902e-74a6091cf2a4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.259457 Jul 04 05:56:44.481138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 191/393] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:44 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:44.631733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cbb6fabc-0e7b-42ab-9b3e-8daedb88e811 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:44.647401 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cbb6fabc-0e7b-42ab-9b3e-8daedb88e811 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:44.649810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cbb6fabc-0e7b-42ab-9b3e-8daedb88e811 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:44.654177 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cbb6fabc-0e7b-42ab-9b3e-8daedb88e811 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.303129 Jul 04 05:56:44.659028 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 203/394] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:44 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:44.665206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aea3586f-317e-47d8-855a-4cb2e5ec7eec tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:44.666264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aea3586f-317e-47d8-855a-4cb2e5ec7eec tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:44.679214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aea3586f-317e-47d8-855a-4cb2e5ec7eec tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:44.679951 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aea3586f-317e-47d8-855a-4cb2e5ec7eec tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:44.682306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aea3586f-317e-47d8-855a-4cb2e5ec7eec tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:44.682899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aea3586f-317e-47d8-855a-4cb2e5ec7eec tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:44.796230 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-47f94348-7e19-4a66-bbc8-1de4411679be req-1f0706d5-5020-4d53-a0f8-02cf69b33c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf08277-34bd-4abc-b791-020400737f7e", "name": "network-vif-plugged", "status": "completed", "tag": "cbf83c6a-9b07-4cfd-b772-2de8a2a1b628"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:44.808246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-47f94348-7e19-4a66-bbc8-1de4411679be req-1f0706d5-5020-4d53-a0f8-02cf69b33c90 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:44.808678 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-47f94348-7e19-4a66-bbc8-1de4411679be req-1f0706d5-5020-4d53-a0f8-02cf69b33c90 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:44.841622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-47f94348-7e19-4a66-bbc8-1de4411679be req-1f0706d5-5020-4d53-a0f8-02cf69b33c90 service nova] Creating event network-vif-plugged:cbf83c6a-9b07-4cfd-b772-2de8a2a1b628 for instance 6bf08277-34bd-4abc-b791-020400737f7e on hv-cinder-79733 Jul 04 05:56:44.854076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-47f94348-7e19-4a66-bbc8-1de4411679be req-1f0706d5-5020-4d53-a0f8-02cf69b33c90 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063976 Jul 04 05:56:44.863530 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 204/395] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:56:44.924472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aea3586f-317e-47d8-855a-4cb2e5ec7eec tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:44.938861 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aea3586f-317e-47d8-855a-4cb2e5ec7eec tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.279321 Jul 04 05:56:44.939767 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 192/396] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:44 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:45.218183 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-87b29a6e-694d-450c-b62c-b6a36fa62894 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:45.218945 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-87b29a6e-694d-450c-b62c-b6a36fa62894 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:45.239569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87b29a6e-694d-450c-b62c-b6a36fa62894 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:45.239569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87b29a6e-694d-450c-b62c-b6a36fa62894 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:45.239569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87b29a6e-694d-450c-b62c-b6a36fa62894 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:45.239569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87b29a6e-694d-450c-b62c-b6a36fa62894 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:45.283283 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b9a09ba-5657-4cbd-a311-8f316b9039fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:45.294287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b9a09ba-5657-4cbd-a311-8f316b9039fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:45.307918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b9a09ba-5657-4cbd-a311-8f316b9039fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:45.308637 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b9a09ba-5657-4cbd-a311-8f316b9039fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:45.309601 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b9a09ba-5657-4cbd-a311-8f316b9039fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:45.310045 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b9a09ba-5657-4cbd-a311-8f316b9039fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:45.435497 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-87b29a6e-694d-450c-b62c-b6a36fa62894 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:45.445941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-87b29a6e-694d-450c-b62c-b6a36fa62894 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.232208 Jul 04 05:56:45.446822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 205/397] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:45 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:45.477617 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b9a09ba-5657-4cbd-a311-8f316b9039fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:45.485190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b9a09ba-5657-4cbd-a311-8f316b9039fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.205681 Jul 04 05:56:45.485769 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 193/398] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:45 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:45.501092 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bbcc99f6-bb65-431d-a77a-5a9cf5f1e2f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:45.501777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bbcc99f6-bb65-431d-a77a-5a9cf5f1e2f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:45.508812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbcc99f6-bb65-431d-a77a-5a9cf5f1e2f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:45.509251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbcc99f6-bb65-431d-a77a-5a9cf5f1e2f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:45.510686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbcc99f6-bb65-431d-a77a-5a9cf5f1e2f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:45.511124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbcc99f6-bb65-431d-a77a-5a9cf5f1e2f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:45.644352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bbcc99f6-bb65-431d-a77a-5a9cf5f1e2f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:45.652307 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bbcc99f6-bb65-431d-a77a-5a9cf5f1e2f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.155440 Jul 04 05:56:45.652913 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 206/399] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:45 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:45.675647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bd2f6178-999f-4b64-b8b8-02d95b51a9ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:45.676251 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bd2f6178-999f-4b64-b8b8-02d95b51a9ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:45.682662 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd2f6178-999f-4b64-b8b8-02d95b51a9ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:45.683109 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd2f6178-999f-4b64-b8b8-02d95b51a9ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:45.684008 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd2f6178-999f-4b64-b8b8-02d95b51a9ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:45.684440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd2f6178-999f-4b64-b8b8-02d95b51a9ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:45.833575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bd2f6178-999f-4b64-b8b8-02d95b51a9ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:45.842318 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bd2f6178-999f-4b64-b8b8-02d95b51a9ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:45.843859 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bd2f6178-999f-4b64-b8b8-02d95b51a9ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:45.845035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bd2f6178-999f-4b64-b8b8-02d95b51a9ce tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.173454 Jul 04 05:56:45.845846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 194/400] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:45 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:45.957465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ffe2d4b8-1723-4169-95ee-056efa443120 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:45.958099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ffe2d4b8-1723-4169-95ee-056efa443120 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:45.964690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffe2d4b8-1723-4169-95ee-056efa443120 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:45.965125 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffe2d4b8-1723-4169-95ee-056efa443120 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:45.965901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffe2d4b8-1723-4169-95ee-056efa443120 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:45.966327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffe2d4b8-1723-4169-95ee-056efa443120 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:46.099701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ffe2d4b8-1723-4169-95ee-056efa443120 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:46.108010 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ffe2d4b8-1723-4169-95ee-056efa443120 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.154825 Jul 04 05:56:46.108839 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 207/401] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:45 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:46.464279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a0cc52a-80cf-4ad0-b0ae-c4db73fe0c92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:46.465014 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1a0cc52a-80cf-4ad0-b0ae-c4db73fe0c92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:46.471829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a0cc52a-80cf-4ad0-b0ae-c4db73fe0c92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:46.472569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a0cc52a-80cf-4ad0-b0ae-c4db73fe0c92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:46.473678 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a0cc52a-80cf-4ad0-b0ae-c4db73fe0c92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:46.474302 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a0cc52a-80cf-4ad0-b0ae-c4db73fe0c92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:46.508472 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7d41de67-8dbf-46ec-8297-af26da830ba1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:46.510762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7d41de67-8dbf-46ec-8297-af26da830ba1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:46.549335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d41de67-8dbf-46ec-8297-af26da830ba1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:46.550304 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d41de67-8dbf-46ec-8297-af26da830ba1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:46.551482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d41de67-8dbf-46ec-8297-af26da830ba1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:46.552111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d41de67-8dbf-46ec-8297-af26da830ba1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:46.694415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a0cc52a-80cf-4ad0-b0ae-c4db73fe0c92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:46.711107 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a0cc52a-80cf-4ad0-b0ae-c4db73fe0c92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.247920 Jul 04 05:56:46.712408 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 195/402] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:46 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:46.719049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a5aae5e4-981a-40b9-956a-bc8eb66b0fcb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:46.721410 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a5aae5e4-981a-40b9-956a-bc8eb66b0fcb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:46.739209 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5aae5e4-981a-40b9-956a-bc8eb66b0fcb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:46.739987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5aae5e4-981a-40b9-956a-bc8eb66b0fcb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:46.741548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5aae5e4-981a-40b9-956a-bc8eb66b0fcb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:46.743645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5aae5e4-981a-40b9-956a-bc8eb66b0fcb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:46.891687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7d41de67-8dbf-46ec-8297-af26da830ba1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:46.903379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7d41de67-8dbf-46ec-8297-af26da830ba1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.404846 Jul 04 05:56:46.904596 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 208/403] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:46 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:46.909661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea4ea5ee-145c-4eaf-8417-dce0159eeaa3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:46.910531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea4ea5ee-145c-4eaf-8417-dce0159eeaa3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:46.920040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea4ea5ee-145c-4eaf-8417-dce0159eeaa3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:46.921346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea4ea5ee-145c-4eaf-8417-dce0159eeaa3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:46.922294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea4ea5ee-145c-4eaf-8417-dce0159eeaa3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:46.922973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea4ea5ee-145c-4eaf-8417-dce0159eeaa3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:46.945671 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a5aae5e4-981a-40b9-956a-bc8eb66b0fcb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:46.955050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a5aae5e4-981a-40b9-956a-bc8eb66b0fcb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.240518 Jul 04 05:56:46.956180 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 196/404] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:46 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:47.081515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea4ea5ee-145c-4eaf-8417-dce0159eeaa3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:47.090246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea4ea5ee-145c-4eaf-8417-dce0159eeaa3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:47.091744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea4ea5ee-145c-4eaf-8417-dce0159eeaa3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:47.092922 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea4ea5ee-145c-4eaf-8417-dce0159eeaa3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.187039 Jul 04 05:56:47.093459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 209/405] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:46 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:47.125326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-81b15a17-7550-4e9f-a4b4-404e916ece27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:47.125942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-81b15a17-7550-4e9f-a4b4-404e916ece27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:47.132497 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81b15a17-7550-4e9f-a4b4-404e916ece27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:47.132950 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81b15a17-7550-4e9f-a4b4-404e916ece27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:47.133729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81b15a17-7550-4e9f-a4b4-404e916ece27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:47.134344 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81b15a17-7550-4e9f-a4b4-404e916ece27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:47.138677 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:47.268308 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-81b15a17-7550-4e9f-a4b4-404e916ece27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:47.275937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-81b15a17-7550-4e9f-a4b4-404e916ece27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.154600 Jul 04 05:56:47.276441 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 197/406] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:47 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:47.729168 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cb053879-4708-4c2b-acc9-24204288e72c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:47.729875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cb053879-4708-4c2b-acc9-24204288e72c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:47.732025 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:47.737430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb053879-4708-4c2b-acc9-24204288e72c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:47.737886 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb053879-4708-4c2b-acc9-24204288e72c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:47.738664 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb053879-4708-4c2b-acc9-24204288e72c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:47.739169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb053879-4708-4c2b-acc9-24204288e72c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:47.921103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eeb20e45-b406-4a67-8b6f-03437f59616e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:47.922469 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eeb20e45-b406-4a67-8b6f-03437f59616e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:47.937389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eeb20e45-b406-4a67-8b6f-03437f59616e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:47.937389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eeb20e45-b406-4a67-8b6f-03437f59616e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:47.937389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eeb20e45-b406-4a67-8b6f-03437f59616e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:47.938219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eeb20e45-b406-4a67-8b6f-03437f59616e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:48.107538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eeb20e45-b406-4a67-8b6f-03437f59616e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:48.117223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eeb20e45-b406-4a67-8b6f-03437f59616e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.200177 Jul 04 05:56:48.118516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 198/407] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:47 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:48.129916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2a488be-dc93-44b1-af71-381077622e19 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:48.130985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f2a488be-dc93-44b1-af71-381077622e19 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:48.148577 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2a488be-dc93-44b1-af71-381077622e19 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:48.149268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2a488be-dc93-44b1-af71-381077622e19 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:48.150112 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2a488be-dc93-44b1-af71-381077622e19 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:48.150622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2a488be-dc93-44b1-af71-381077622e19 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:48.196994 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cb053879-4708-4c2b-acc9-24204288e72c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:48.206312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cb053879-4708-4c2b-acc9-24204288e72c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.480907 Jul 04 05:56:48.208388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 210/408] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:47 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:48.218299 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b63b9c57-440c-48cf-a952-ef2173f91e91 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:48.219431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b63b9c57-440c-48cf-a952-ef2173f91e91 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:48.228031 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b63b9c57-440c-48cf-a952-ef2173f91e91 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:48.229067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b63b9c57-440c-48cf-a952-ef2173f91e91 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:48.230083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b63b9c57-440c-48cf-a952-ef2173f91e91 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:48.230740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b63b9c57-440c-48cf-a952-ef2173f91e91 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:48.375163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2a488be-dc93-44b1-af71-381077622e19 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:48.384495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f2a488be-dc93-44b1-af71-381077622e19 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.264480 Jul 04 05:56:48.385356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 199/409] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:48 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:48.390738 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-06d02ef4-e3ad-47a3-848a-13fe58ed9c21 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:48.391582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-06d02ef4-e3ad-47a3-848a-13fe58ed9c21 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:48.399990 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06d02ef4-e3ad-47a3-848a-13fe58ed9c21 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:48.399990 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06d02ef4-e3ad-47a3-848a-13fe58ed9c21 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:48.401237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06d02ef4-e3ad-47a3-848a-13fe58ed9c21 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:48.401237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06d02ef4-e3ad-47a3-848a-13fe58ed9c21 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:48.435697 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b63b9c57-440c-48cf-a952-ef2173f91e91 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:48.449234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b63b9c57-440c-48cf-a952-ef2173f91e91 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:48.451208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b63b9c57-440c-48cf-a952-ef2173f91e91 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:48.452918 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b63b9c57-440c-48cf-a952-ef2173f91e91 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.243199 Jul 04 05:56:48.454095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 211/410] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:48 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:48.576059 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-06d02ef4-e3ad-47a3-848a-13fe58ed9c21 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:48.583968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-06d02ef4-e3ad-47a3-848a-13fe58ed9c21 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.197352 Jul 04 05:56:48.584839 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 200/411] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:48 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:49.134223 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1f304be4-9a6f-4e79-a098-89d0b259c3d6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:49.134828 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1f304be4-9a6f-4e79-a098-89d0b259c3d6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:49.141383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f304be4-9a6f-4e79-a098-89d0b259c3d6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:49.141827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f304be4-9a6f-4e79-a098-89d0b259c3d6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:49.142604 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f304be4-9a6f-4e79-a098-89d0b259c3d6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:49.143037 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f304be4-9a6f-4e79-a098-89d0b259c3d6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:49.225574 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ed0c3e7e-e06f-43fa-a041-42fb51fdc4dc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:49.226876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ed0c3e7e-e06f-43fa-a041-42fb51fdc4dc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:49.234546 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed0c3e7e-e06f-43fa-a041-42fb51fdc4dc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:49.235112 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed0c3e7e-e06f-43fa-a041-42fb51fdc4dc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:49.235937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed0c3e7e-e06f-43fa-a041-42fb51fdc4dc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:49.236375 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed0c3e7e-e06f-43fa-a041-42fb51fdc4dc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:49.281459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f304be4-9a6f-4e79-a098-89d0b259c3d6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:49.292275 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f304be4-9a6f-4e79-a098-89d0b259c3d6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.161957 Jul 04 05:56:49.296354 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 212/412] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:49 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:49.401181 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-316e8f15-86e5-412c-acd4-b1dfd67a8d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:49.401804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-316e8f15-86e5-412c-acd4-b1dfd67a8d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:49.410004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-316e8f15-86e5-412c-acd4-b1dfd67a8d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:49.414562 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ed0c3e7e-e06f-43fa-a041-42fb51fdc4dc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:49.422926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-316e8f15-86e5-412c-acd4-b1dfd67a8d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:49.424687 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ed0c3e7e-e06f-43fa-a041-42fb51fdc4dc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.203017 Jul 04 05:56:49.425403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 201/413] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:49 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:49.436232 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-316e8f15-86e5-412c-acd4-b1dfd67a8d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:49.436799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-316e8f15-86e5-412c-acd4-b1dfd67a8d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:49.471621 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ba43528-7dfe-4f81-b465-be7ff1fba6dd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:49.472225 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ba43528-7dfe-4f81-b465-be7ff1fba6dd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:49.487145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ba43528-7dfe-4f81-b465-be7ff1fba6dd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:49.487630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ba43528-7dfe-4f81-b465-be7ff1fba6dd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:49.488411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ba43528-7dfe-4f81-b465-be7ff1fba6dd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:49.488845 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ba43528-7dfe-4f81-b465-be7ff1fba6dd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:49.651903 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-316e8f15-86e5-412c-acd4-b1dfd67a8d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:49.662804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-316e8f15-86e5-412c-acd4-b1dfd67a8d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.265395 Jul 04 05:56:49.663431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 213/414] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:49 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:49.673998 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-22b772d6-992c-45c2-9b8d-e14628771d73 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:49.676321 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-22b772d6-992c-45c2-9b8d-e14628771d73 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:49.691465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22b772d6-992c-45c2-9b8d-e14628771d73 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:49.691924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22b772d6-992c-45c2-9b8d-e14628771d73 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:49.692778 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22b772d6-992c-45c2-9b8d-e14628771d73 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:49.693215 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22b772d6-992c-45c2-9b8d-e14628771d73 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:49.736271 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ba43528-7dfe-4f81-b465-be7ff1fba6dd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:49.752320 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ba43528-7dfe-4f81-b465-be7ff1fba6dd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:49.753823 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ba43528-7dfe-4f81-b465-be7ff1fba6dd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:49.755064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ba43528-7dfe-4f81-b465-be7ff1fba6dd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.287383 Jul 04 05:56:49.755989 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 202/415] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:49 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:49.848046 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-22b772d6-992c-45c2-9b8d-e14628771d73 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:49.857262 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-22b772d6-992c-45c2-9b8d-e14628771d73 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.187228 Jul 04 05:56:49.858053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 214/416] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:49 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:50.312322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8cddc4b3-2c9e-49e6-98d7-5d6c1917201d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:50.313748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8cddc4b3-2c9e-49e6-98d7-5d6c1917201d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:50.321920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cddc4b3-2c9e-49e6-98d7-5d6c1917201d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:50.322633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cddc4b3-2c9e-49e6-98d7-5d6c1917201d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:50.323712 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cddc4b3-2c9e-49e6-98d7-5d6c1917201d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:50.324506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cddc4b3-2c9e-49e6-98d7-5d6c1917201d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:50.442724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-83284b20-2bb6-47f2-af6a-41db2f348333 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:50.444142 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-83284b20-2bb6-47f2-af6a-41db2f348333 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:50.452160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83284b20-2bb6-47f2-af6a-41db2f348333 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:50.453595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83284b20-2bb6-47f2-af6a-41db2f348333 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:50.457684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83284b20-2bb6-47f2-af6a-41db2f348333 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:50.458433 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83284b20-2bb6-47f2-af6a-41db2f348333 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:50.473786 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8cddc4b3-2c9e-49e6-98d7-5d6c1917201d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:50.481914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8cddc4b3-2c9e-49e6-98d7-5d6c1917201d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.173328 Jul 04 05:56:50.491623 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 203/417] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:50 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:50.627622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-83284b20-2bb6-47f2-af6a-41db2f348333 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:50.636024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-83284b20-2bb6-47f2-af6a-41db2f348333 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.197692 Jul 04 05:56:50.637350 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 215/418] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:50 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:50.680882 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-82aa193c-2561-4d8a-950b-aa8509eb88e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:50.681681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-82aa193c-2561-4d8a-950b-aa8509eb88e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:50.687822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82aa193c-2561-4d8a-950b-aa8509eb88e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:50.688267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82aa193c-2561-4d8a-950b-aa8509eb88e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:50.689169 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82aa193c-2561-4d8a-950b-aa8509eb88e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:50.689640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82aa193c-2561-4d8a-950b-aa8509eb88e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:50.774365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1256c826-4391-4a23-91a1-eec7c65dbdb8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:50.775117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1256c826-4391-4a23-91a1-eec7c65dbdb8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:50.781479 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1256c826-4391-4a23-91a1-eec7c65dbdb8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:50.782177 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1256c826-4391-4a23-91a1-eec7c65dbdb8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:50.783060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1256c826-4391-4a23-91a1-eec7c65dbdb8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:50.783544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1256c826-4391-4a23-91a1-eec7c65dbdb8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:50.834566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-82aa193c-2561-4d8a-950b-aa8509eb88e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:50.842702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-82aa193c-2561-4d8a-950b-aa8509eb88e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.166426 Jul 04 05:56:50.843428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 204/419] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:50 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:50.874482 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-727a8041-7be5-4547-b9a5-28f1632efe6b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:50.875372 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-727a8041-7be5-4547-b9a5-28f1632efe6b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:50.881761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-727a8041-7be5-4547-b9a5-28f1632efe6b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:50.882413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-727a8041-7be5-4547-b9a5-28f1632efe6b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:50.884136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-727a8041-7be5-4547-b9a5-28f1632efe6b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:50.884596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-727a8041-7be5-4547-b9a5-28f1632efe6b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:50.927724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1256c826-4391-4a23-91a1-eec7c65dbdb8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:50.936835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1256c826-4391-4a23-91a1-eec7c65dbdb8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:50.938579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1256c826-4391-4a23-91a1-eec7c65dbdb8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:50.939671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1256c826-4391-4a23-91a1-eec7c65dbdb8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.170328 Jul 04 05:56:50.946811 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 216/420] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:50 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:56:51.019154 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-727a8041-7be5-4547-b9a5-28f1632efe6b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:51.026810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-727a8041-7be5-4547-b9a5-28f1632efe6b tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.156886 Jul 04 05:56:51.027620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 205/421] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:50 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:51.498057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5036fd69-3a5f-433c-9ee3-b65a012be51d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:51.498671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5036fd69-3a5f-433c-9ee3-b65a012be51d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:51.505677 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5036fd69-3a5f-433c-9ee3-b65a012be51d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:51.506213 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5036fd69-3a5f-433c-9ee3-b65a012be51d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:51.507004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5036fd69-3a5f-433c-9ee3-b65a012be51d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:51.507474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5036fd69-3a5f-433c-9ee3-b65a012be51d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:51.651586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5036fd69-3a5f-433c-9ee3-b65a012be51d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:51.653924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d829ac6d-675e-4f0f-bc27-ffbb438e517e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:51.654559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d829ac6d-675e-4f0f-bc27-ffbb438e517e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:51.660178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5036fd69-3a5f-433c-9ee3-b65a012be51d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1319 microversion: 2.1 time: 0.165971 Jul 04 05:56:51.660769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 217/422] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:51 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:51.661269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d829ac6d-675e-4f0f-bc27-ffbb438e517e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:51.661815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d829ac6d-675e-4f0f-bc27-ffbb438e517e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:51.662980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d829ac6d-675e-4f0f-bc27-ffbb438e517e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:51.663883 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d829ac6d-675e-4f0f-bc27-ffbb438e517e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:51.809084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d829ac6d-675e-4f0f-bc27-ffbb438e517e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:51.817749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d829ac6d-675e-4f0f-bc27-ffbb438e517e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1721 microversion: 2.1 time: 0.167594 Jul 04 05:56:51.818619 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 206/423] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:51 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:51.860059 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c52e5b4e-f9a5-4d4c-8026-6344ce16746b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:51.860661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c52e5b4e-f9a5-4d4c-8026-6344ce16746b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:51.866960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c52e5b4e-f9a5-4d4c-8026-6344ce16746b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:51.867434 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c52e5b4e-f9a5-4d4c-8026-6344ce16746b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:51.868182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c52e5b4e-f9a5-4d4c-8026-6344ce16746b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:51.868598 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c52e5b4e-f9a5-4d4c-8026-6344ce16746b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:51.964178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-59d6aa19-1610-4872-993e-bafff32f791e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:51.965062 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-59d6aa19-1610-4872-993e-bafff32f791e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:51.972355 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59d6aa19-1610-4872-993e-bafff32f791e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:51.972805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59d6aa19-1610-4872-993e-bafff32f791e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:51.973850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59d6aa19-1610-4872-993e-bafff32f791e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:51.974448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59d6aa19-1610-4872-993e-bafff32f791e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:52.014664 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c52e5b4e-f9a5-4d4c-8026-6344ce16746b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:52.023574 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c52e5b4e-f9a5-4d4c-8026-6344ce16746b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.167434 Jul 04 05:56:52.035308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 218/424] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:51 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:52.044223 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b7256b03-9449-4677-8a8a-0a9b35a8a863 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:52.044969 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b7256b03-9449-4677-8a8a-0a9b35a8a863 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:52.051974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7256b03-9449-4677-8a8a-0a9b35a8a863 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:52.052504 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7256b03-9449-4677-8a8a-0a9b35a8a863 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:52.053296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7256b03-9449-4677-8a8a-0a9b35a8a863 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:52.053727 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7256b03-9449-4677-8a8a-0a9b35a8a863 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:52.143527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-59d6aa19-1610-4872-993e-bafff32f791e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:52.152220 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-59d6aa19-1610-4872-993e-bafff32f791e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:52.153942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-59d6aa19-1610-4872-993e-bafff32f791e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:52.155189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-59d6aa19-1610-4872-993e-bafff32f791e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.201231 Jul 04 05:56:52.155940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 207/425] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:51 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:52.241489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b7256b03-9449-4677-8a8a-0a9b35a8a863 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:52.249804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b7256b03-9449-4677-8a8a-0a9b35a8a863 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.209367 Jul 04 05:56:52.251225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 219/426] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:52 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:52.679785 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f5e7aa1a-7e00-4483-b95d-751dc5843911 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:52.680406 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f5e7aa1a-7e00-4483-b95d-751dc5843911 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:52.687485 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5e7aa1a-7e00-4483-b95d-751dc5843911 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:52.687929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5e7aa1a-7e00-4483-b95d-751dc5843911 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:52.688702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5e7aa1a-7e00-4483-b95d-751dc5843911 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:52.689130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5e7aa1a-7e00-4483-b95d-751dc5843911 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:52.826666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f5e7aa1a-7e00-4483-b95d-751dc5843911 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:52.834710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f5e7aa1a-7e00-4483-b95d-751dc5843911 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1508 microversion: 2.1 time: 0.159784 Jul 04 05:56:52.839161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 208/427] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:52 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:52.839343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-91466659-7484-406c-8665-4fc83c04fc7f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:52.839343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-91466659-7484-406c-8665-4fc83c04fc7f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:52.842987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91466659-7484-406c-8665-4fc83c04fc7f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:52.843557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91466659-7484-406c-8665-4fc83c04fc7f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:52.844403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91466659-7484-406c-8665-4fc83c04fc7f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:52.844904 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91466659-7484-406c-8665-4fc83c04fc7f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:52.982904 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-91466659-7484-406c-8665-4fc83c04fc7f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:52.986348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:52.991800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-91466659-7484-406c-8665-4fc83c04fc7f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1698 microversion: 2.1 time: 0.159725 Jul 04 05:56:52.992226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 220/428] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:52 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:53.008664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f836c1cc-838d-46b8-96cb-0131575c08d3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:53.014901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f836c1cc-838d-46b8-96cb-0131575c08d3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:53.015498 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f836c1cc-838d-46b8-96cb-0131575c08d3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:53.044499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b7495b72-036b-4362-94af-696ebaacff54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:53.045105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b7495b72-036b-4362-94af-696ebaacff54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:53.052320 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7495b72-036b-4362-94af-696ebaacff54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:53.052975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7495b72-036b-4362-94af-696ebaacff54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:53.053929 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7495b72-036b-4362-94af-696ebaacff54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:53.054520 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7495b72-036b-4362-94af-696ebaacff54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:53.075571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f836c1cc-838d-46b8-96cb-0131575c08d3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Going to try to start instance {{(pid=117606) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 05:56:53.123170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f836c1cc-838d-46b8-96cb-0131575c08d3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "POST /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/action" status: 202 len: 0 microversion: 2.1 time: 0.118056 Jul 04 05:56:53.123791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 209/429] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 05:56:53 2022] POST /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:56:53.132312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c7b4d84a-0e28-4efd-ad92-d412e873c83f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:53.133002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c7b4d84a-0e28-4efd-ad92-d412e873c83f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:53.140955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7b4d84a-0e28-4efd-ad92-d412e873c83f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:53.141660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7b4d84a-0e28-4efd-ad92-d412e873c83f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:53.142531 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7b4d84a-0e28-4efd-ad92-d412e873c83f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:53.142966 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7b4d84a-0e28-4efd-ad92-d412e873c83f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:53.217577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b7495b72-036b-4362-94af-696ebaacff54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:53.225976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b7495b72-036b-4362-94af-696ebaacff54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.185628 Jul 04 05:56:53.226901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 221/430] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:53 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:53.232199 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7b86e9ce-82ff-4a74-a5d3-66d545679d5a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:53.233189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7b86e9ce-82ff-4a74-a5d3-66d545679d5a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:53.240547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b86e9ce-82ff-4a74-a5d3-66d545679d5a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:53.241249 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b86e9ce-82ff-4a74-a5d3-66d545679d5a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:53.242279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b86e9ce-82ff-4a74-a5d3-66d545679d5a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:53.243009 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b86e9ce-82ff-4a74-a5d3-66d545679d5a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:53.325135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c7b4d84a-0e28-4efd-ad92-d412e873c83f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:53.335886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c7b4d84a-0e28-4efd-ad92-d412e873c83f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1707 microversion: 2.1 time: 0.207392 Jul 04 05:56:53.346773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 210/431] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:53 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1707 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:53.353102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8aaf2015-add9-466c-8a04-25c95258e777 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:53.353914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8aaf2015-add9-466c-8a04-25c95258e777 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:53.362317 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aaf2015-add9-466c-8a04-25c95258e777 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:53.363038 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aaf2015-add9-466c-8a04-25c95258e777 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:53.364080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aaf2015-add9-466c-8a04-25c95258e777 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:53.364723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aaf2015-add9-466c-8a04-25c95258e777 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:53.468182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b86e9ce-82ff-4a74-a5d3-66d545679d5a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:53.470982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b86e9ce-82ff-4a74-a5d3-66d545679d5a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:53.473042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b86e9ce-82ff-4a74-a5d3-66d545679d5a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:53.474255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7b86e9ce-82ff-4a74-a5d3-66d545679d5a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.246167 Jul 04 05:56:53.474978 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 222/432] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:53 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:53.523493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8aaf2015-add9-466c-8a04-25c95258e777 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:53.531065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8aaf2015-add9-466c-8a04-25c95258e777 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.182865 Jul 04 05:56:53.531789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 211/433] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:53 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:54.243992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aae689c4-1a8c-4183-9596-9656b13c5834 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:54.244595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aae689c4-1a8c-4183-9596-9656b13c5834 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:54.251182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae689c4-1a8c-4183-9596-9656b13c5834 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:54.251677 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae689c4-1a8c-4183-9596-9656b13c5834 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:54.252451 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae689c4-1a8c-4183-9596-9656b13c5834 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:54.252884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae689c4-1a8c-4183-9596-9656b13c5834 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:54.353479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f8283390-9169-4ac4-9b3c-3e432ad4d1f6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:54.354047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f8283390-9169-4ac4-9b3c-3e432ad4d1f6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:54.360915 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8283390-9169-4ac4-9b3c-3e432ad4d1f6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:54.361363 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8283390-9169-4ac4-9b3c-3e432ad4d1f6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:54.362105 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8283390-9169-4ac4-9b3c-3e432ad4d1f6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:54.362542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8283390-9169-4ac4-9b3c-3e432ad4d1f6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:54.394716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aae689c4-1a8c-4183-9596-9656b13c5834 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:54.402713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aae689c4-1a8c-4183-9596-9656b13c5834 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.162663 Jul 04 05:56:54.403477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 223/434] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:54 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:54.493024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f917265f-a418-4e5c-ba72-7d94e655c1e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:54.493660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f917265f-a418-4e5c-ba72-7d94e655c1e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:54.506149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f917265f-a418-4e5c-ba72-7d94e655c1e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:54.506377 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f8283390-9169-4ac4-9b3c-3e432ad4d1f6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:54.506923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f917265f-a418-4e5c-ba72-7d94e655c1e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:54.510125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:54.510481 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f917265f-a418-4e5c-ba72-7d94e655c1e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:54.511022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f917265f-a418-4e5c-ba72-7d94e655c1e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:54.515629 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f8283390-9169-4ac4-9b3c-3e432ad4d1f6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1707 microversion: 2.1 time: 0.165916 Jul 04 05:56:54.525968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 212/435] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:54 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1707 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:54.551401 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8d976eac-e3d3-4009-b916-3ff17bd53812 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:54.552024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8d976eac-e3d3-4009-b916-3ff17bd53812 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:54.559615 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d976eac-e3d3-4009-b916-3ff17bd53812 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:54.560073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d976eac-e3d3-4009-b916-3ff17bd53812 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:54.560855 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d976eac-e3d3-4009-b916-3ff17bd53812 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:54.561322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d976eac-e3d3-4009-b916-3ff17bd53812 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:54.676896 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f917265f-a418-4e5c-ba72-7d94e655c1e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:54.685569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f917265f-a418-4e5c-ba72-7d94e655c1e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:54.687057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f917265f-a418-4e5c-ba72-7d94e655c1e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:54.688254 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f917265f-a418-4e5c-ba72-7d94e655c1e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.199209 Jul 04 05:56:54.688801 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 224/436] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:54 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:54.713018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d976eac-e3d3-4009-b916-3ff17bd53812 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:54.723964 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8d976eac-e3d3-4009-b916-3ff17bd53812 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.178820 Jul 04 05:56:54.724749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 213/437] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:54 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:55.420767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ffb9182c-2023-4dfd-b84f-2cfc968e8f56 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:55.421407 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ffb9182c-2023-4dfd-b84f-2cfc968e8f56 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:55.428040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffb9182c-2023-4dfd-b84f-2cfc968e8f56 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:55.428532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffb9182c-2023-4dfd-b84f-2cfc968e8f56 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:55.429313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffb9182c-2023-4dfd-b84f-2cfc968e8f56 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:55.429749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffb9182c-2023-4dfd-b84f-2cfc968e8f56 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:55.533607 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-33da1606-3e85-409f-9d2d-701d1a560cc0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:55.534260 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-33da1606-3e85-409f-9d2d-701d1a560cc0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:55.541113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33da1606-3e85-409f-9d2d-701d1a560cc0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:55.541634 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33da1606-3e85-409f-9d2d-701d1a560cc0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:55.542512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33da1606-3e85-409f-9d2d-701d1a560cc0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:55.543028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33da1606-3e85-409f-9d2d-701d1a560cc0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:55.563138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ffb9182c-2023-4dfd-b84f-2cfc968e8f56 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:55.570960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ffb9182c-2023-4dfd-b84f-2cfc968e8f56 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.154511 Jul 04 05:56:55.571580 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 225/438] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:55 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:55.680000 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-33da1606-3e85-409f-9d2d-701d1a560cc0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:55.688317 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-33da1606-3e85-409f-9d2d-701d1a560cc0 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1707 microversion: 2.1 time: 0.158782 Jul 04 05:56:55.689129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 214/439] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:55 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:55.709119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8086980e-dc04-4313-b799-4300479d291d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:55.710004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8086980e-dc04-4313-b799-4300479d291d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:55.715941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8086980e-dc04-4313-b799-4300479d291d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:55.716402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8086980e-dc04-4313-b799-4300479d291d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:55.717163 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8086980e-dc04-4313-b799-4300479d291d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:55.717593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8086980e-dc04-4313-b799-4300479d291d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:55.745214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-005517a0-cbd5-4b01-a626-2f034e06dd27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:55.746103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-005517a0-cbd5-4b01-a626-2f034e06dd27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:55.753423 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-005517a0-cbd5-4b01-a626-2f034e06dd27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:55.754496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-005517a0-cbd5-4b01-a626-2f034e06dd27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:55.755621 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-005517a0-cbd5-4b01-a626-2f034e06dd27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:55.756980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-005517a0-cbd5-4b01-a626-2f034e06dd27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:55.909003 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-005517a0-cbd5-4b01-a626-2f034e06dd27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:55.912669 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8086980e-dc04-4313-b799-4300479d291d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:55.918208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-005517a0-cbd5-4b01-a626-2f034e06dd27 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1314 microversion: 2.1 time: 0.176711 Jul 04 05:56:55.928357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 215/440] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:55 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:55.928579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8086980e-dc04-4313-b799-4300479d291d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:55.928579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8086980e-dc04-4313-b799-4300479d291d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:55.928579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8086980e-dc04-4313-b799-4300479d291d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.219607 Jul 04 05:56:55.935845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 226/441] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:55 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:56.589563 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5d3d2c14-fc3a-414e-9d5b-bc47f669f049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:56.590924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5d3d2c14-fc3a-414e-9d5b-bc47f669f049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:56.597819 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d3d2c14-fc3a-414e-9d5b-bc47f669f049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:56.598264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d3d2c14-fc3a-414e-9d5b-bc47f669f049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:56.599064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d3d2c14-fc3a-414e-9d5b-bc47f669f049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:56.599743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d3d2c14-fc3a-414e-9d5b-bc47f669f049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:56.711907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5c2a61e3-54ee-4db6-a46c-b2164a6401d6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:56.712538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5c2a61e3-54ee-4db6-a46c-b2164a6401d6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:56.722810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c2a61e3-54ee-4db6-a46c-b2164a6401d6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:56.723269 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c2a61e3-54ee-4db6-a46c-b2164a6401d6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:56.724116 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c2a61e3-54ee-4db6-a46c-b2164a6401d6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:56.724621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c2a61e3-54ee-4db6-a46c-b2164a6401d6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:56.752372 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5d3d2c14-fc3a-414e-9d5b-bc47f669f049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:56.760192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5d3d2c14-fc3a-414e-9d5b-bc47f669f049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.174916 Jul 04 05:56:56.760774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 216/442] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:56 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:56.858345 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c2a61e3-54ee-4db6-a46c-b2164a6401d6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:56.867317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5c2a61e3-54ee-4db6-a46c-b2164a6401d6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1707 microversion: 2.1 time: 0.159319 Jul 04 05:56:56.867929 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 227/443] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:56 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:56.938855 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31b5700e-12e4-4421-8b95-daf920d47c61 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:56.939711 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31b5700e-12e4-4421-8b95-daf920d47c61 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:56.945208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-35d673f0-86c8-40ba-8430-7d8c74712dc3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:56.946154 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-35d673f0-86c8-40ba-8430-7d8c74712dc3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:56.948259 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b5700e-12e4-4421-8b95-daf920d47c61 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:56.948773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b5700e-12e4-4421-8b95-daf920d47c61 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:56.949801 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b5700e-12e4-4421-8b95-daf920d47c61 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:56.950383 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b5700e-12e4-4421-8b95-daf920d47c61 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:56.954057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35d673f0-86c8-40ba-8430-7d8c74712dc3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:56.954652 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35d673f0-86c8-40ba-8430-7d8c74712dc3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:56.955720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35d673f0-86c8-40ba-8430-7d8c74712dc3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:56.956297 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35d673f0-86c8-40ba-8430-7d8c74712dc3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:57.089514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31b5700e-12e4-4421-8b95-daf920d47c61 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:57.097700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-31b5700e-12e4-4421-8b95-daf920d47c61 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1498 microversion: 2.1 time: 0.164974 Jul 04 05:56:57.098278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 217/444] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:56 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:57.142892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-35d673f0-86c8-40ba-8430-7d8c74712dc3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:57.152218 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-35d673f0-86c8-40ba-8430-7d8c74712dc3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:57.154043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-35d673f0-86c8-40ba-8430-7d8c74712dc3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:57.155214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-35d673f0-86c8-40ba-8430-7d8c74712dc3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.215415 Jul 04 05:56:57.155834 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 228/445] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:56 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:57.732368 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3eeea906-bc90-4ae1-a4af-fe67bcb6dc0c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:57.732908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3eeea906-bc90-4ae1-a4af-fe67bcb6dc0c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:57.739856 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3eeea906-bc90-4ae1-a4af-fe67bcb6dc0c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:57.740378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3eeea906-bc90-4ae1-a4af-fe67bcb6dc0c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:57.741090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3eeea906-bc90-4ae1-a4af-fe67bcb6dc0c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:57.741556 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3eeea906-bc90-4ae1-a4af-fe67bcb6dc0c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:57.767785 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3eeea906-bc90-4ae1-a4af-fe67bcb6dc0c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 05:56:57.777289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-07260734-6bd9-4dff-87a9-73eb7980dee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:57.778122 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-07260734-6bd9-4dff-87a9-73eb7980dee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:57.784574 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07260734-6bd9-4dff-87a9-73eb7980dee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:57.785025 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07260734-6bd9-4dff-87a9-73eb7980dee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:57.785794 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07260734-6bd9-4dff-87a9-73eb7980dee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:57.786229 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07260734-6bd9-4dff-87a9-73eb7980dee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:57.840585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:57.853071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3eeea906-bc90-4ae1-a4af-fe67bcb6dc0c tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 204 len: 0 microversion: 2.1 time: 0.124306 Jul 04 05:56:57.856813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 218/446] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 05:56:57 2022] DELETE /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 05:56:57.862926 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c7041b65-5594-42f7-9c7f-b20b9fb90c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:57.863745 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c7041b65-5594-42f7-9c7f-b20b9fb90c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:57.871929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7041b65-5594-42f7-9c7f-b20b9fb90c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:57.872938 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7041b65-5594-42f7-9c7f-b20b9fb90c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:57.873540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7041b65-5594-42f7-9c7f-b20b9fb90c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:57.874040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7041b65-5594-42f7-9c7f-b20b9fb90c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:57.944637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-07260734-6bd9-4dff-87a9-73eb7980dee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:57.952283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-07260734-6bd9-4dff-87a9-73eb7980dee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.178860 Jul 04 05:56:57.952963 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 229/447] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:57 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:57.957554 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-838c6b04-7804-4834-84cd-6b669c126422 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:57.958139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-838c6b04-7804-4834-84cd-6b669c126422 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:57.964391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-838c6b04-7804-4834-84cd-6b669c126422 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:57.965301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-838c6b04-7804-4834-84cd-6b669c126422 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:57.965627 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-838c6b04-7804-4834-84cd-6b669c126422 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:57.966006 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-838c6b04-7804-4834-84cd-6b669c126422 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:58.019104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c7041b65-5594-42f7-9c7f-b20b9fb90c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:58.026891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c7041b65-5594-42f7-9c7f-b20b9fb90c29 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1504 microversion: 2.1 time: 0.168667 Jul 04 05:56:58.027496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 219/448] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:57 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:58.116683 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-838c6b04-7804-4834-84cd-6b669c126422 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:58.128712 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-838c6b04-7804-4834-84cd-6b669c126422 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1707 microversion: 2.1 time: 0.174498 Jul 04 05:56:58.129493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 230/449] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:57 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1707 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:58.174011 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f48ab193-3e4e-4a28-b006-7ed8bd904e2e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:58.174648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f48ab193-3e4e-4a28-b006-7ed8bd904e2e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:58.181403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f48ab193-3e4e-4a28-b006-7ed8bd904e2e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:58.181891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f48ab193-3e4e-4a28-b006-7ed8bd904e2e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:58.182637 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f48ab193-3e4e-4a28-b006-7ed8bd904e2e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:58.183104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f48ab193-3e4e-4a28-b006-7ed8bd904e2e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:58.319512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f48ab193-3e4e-4a28-b006-7ed8bd904e2e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:58.328347 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f48ab193-3e4e-4a28-b006-7ed8bd904e2e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:58.329829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f48ab193-3e4e-4a28-b006-7ed8bd904e2e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:58.330979 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f48ab193-3e4e-4a28-b006-7ed8bd904e2e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.161368 Jul 04 05:56:58.331576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 220/450] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:58 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:56:58.969784 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ce087001-4f87-4335-bd41-74305f86aedc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:58.970361 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ce087001-4f87-4335-bd41-74305f86aedc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:58.977085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce087001-4f87-4335-bd41-74305f86aedc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:58.977538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce087001-4f87-4335-bd41-74305f86aedc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:58.978304 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce087001-4f87-4335-bd41-74305f86aedc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:58.978738 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce087001-4f87-4335-bd41-74305f86aedc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.046823 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-988bd9cb-03a8-4b57-b58d-72cb07a17009 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:59.048336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-988bd9cb-03a8-4b57-b58d-72cb07a17009 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:59.055583 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-988bd9cb-03a8-4b57-b58d-72cb07a17009 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.056032 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-988bd9cb-03a8-4b57-b58d-72cb07a17009 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.056845 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-988bd9cb-03a8-4b57-b58d-72cb07a17009 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.057293 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-988bd9cb-03a8-4b57-b58d-72cb07a17009 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.114855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ce087001-4f87-4335-bd41-74305f86aedc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:59.122621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ce087001-4f87-4335-bd41-74305f86aedc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1498 microversion: 2.1 time: 0.156944 Jul 04 05:56:59.123312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 231/451] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:58 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:59.138968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15822577-b21c-41ef-b215-738778111a8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac5b9134-f3b5-4702-aff1-528b0bc79d78"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:59.140164 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-15822577-b21c-41ef-b215-738778111a8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:59.146931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15822577-b21c-41ef-b215-738778111a8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.147418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15822577-b21c-41ef-b215-738778111a8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.148195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15822577-b21c-41ef-b215-738778111a8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.148625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15822577-b21c-41ef-b215-738778111a8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.172421 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-15822577-b21c-41ef-b215-738778111a8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] HTTP exception thrown: Cannot 'attach_volume' instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 while it is in vm_state rescued Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15822577-b21c-41ef-b215-738778111a8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Request method failure captured: Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: POST /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6/os-volume_attachments HTTP/1.1 Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 74 Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoDWduuQd-4LtLNBEsfndOQNnXdCxbhhefkVWxp7Albf8nz6dEzS5A6jt7Yk4-6ho1E-i8y4BxVlVPtK6kmSp7NVCcP2VYorrWW6H95pQXHmX2qA8R11XcUz1Tm7EZIHyhBTnPj1d2JHdR1z7jukPed2TtJYhxuENM3DtP7zltIxXrg Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 27aa4fc6d2bd46d3a3492cf0b1d7ae9d Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:56:59.174127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 27aa4fc6d2bd46d3a3492cf0b1d7ae9d Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-ServerRescueNegativeTestJSON-1901791098-project Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 93ae888c6e364e2e96ff52e63415a0e5 Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1901791098-project Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {"volumeAttachment": {"volumeId": "ac5b9134-f3b5-4702-aff1-528b0bc79d78"}} Jul 04 05:56:59.175597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Cannot 'attach_volume' instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 while it is in vm_state rescued Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'server_id': 'b315f101-8d5d-4b0a-994f-f5c7235ddac6', 'body': {'volumeAttachment': {'volumeId': 'ac5b9134-f3b5-4702-aff1-528b0bc79d78'}}} Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:56:59.179862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 while it is in vm_state rescued Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:56:59.181024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:56:59.182382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:56:59.182382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:56:59.182382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 while it is in vm_state rescued Jul 04 05:56:59.182382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:56:59.182382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15822577-b21c-41ef-b215-738778111a8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Returning 409 to user: Cannot 'attach_volume' instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 while it is in vm_state rescued {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:56:59.182382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-15822577-b21c-41ef-b215-738778111a8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040679 Jul 04 05:56:59.182382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 232/452] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jul 4 05:56:59 2022] POST /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 04 05:56:59.182382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a6f1f915-a22c-4825-90a4-fc06f5bd51a1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:59.182985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a6f1f915-a22c-4825-90a4-fc06f5bd51a1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:59.187855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6f1f915-a22c-4825-90a4-fc06f5bd51a1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.188307 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6f1f915-a22c-4825-90a4-fc06f5bd51a1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.189074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6f1f915-a22c-4825-90a4-fc06f5bd51a1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.189508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6f1f915-a22c-4825-90a4-fc06f5bd51a1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.195297 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-988bd9cb-03a8-4b57-b58d-72cb07a17009 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:59.205090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-988bd9cb-03a8-4b57-b58d-72cb07a17009 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1504 microversion: 2.1 time: 0.163176 Jul 04 05:56:59.205864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 221/453] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:59 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:59.210324 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-27a5d37b-1251-4139-bc09-e0b552b499dd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:56:59.210845 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-27a5d37b-1251-4139-bc09-e0b552b499dd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:59.216714 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27a5d37b-1251-4139-bc09-e0b552b499dd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.217155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27a5d37b-1251-4139-bc09-e0b552b499dd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.217913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27a5d37b-1251-4139-bc09-e0b552b499dd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.218343 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27a5d37b-1251-4139-bc09-e0b552b499dd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.288531 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-27a5d37b-1251-4139-bc09-e0b552b499dd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6/action" status: 202 len: 0 microversion: 2.1 time: 0.081615 Jul 04 05:56:59.289175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 222/454] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 05:56:59 2022] POST /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:56:59.298085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45c1b7ae-a176-45cf-b188-ffb739840c43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:59.298784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-45c1b7ae-a176-45cf-b188-ffb739840c43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:59.305234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45c1b7ae-a176-45cf-b188-ffb739840c43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.305686 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45c1b7ae-a176-45cf-b188-ffb739840c43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.306454 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45c1b7ae-a176-45cf-b188-ffb739840c43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.306889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45c1b7ae-a176-45cf-b188-ffb739840c43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.335200 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a6f1f915-a22c-4825-90a4-fc06f5bd51a1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:59.343850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a6f1f915-a22c-4825-90a4-fc06f5bd51a1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1707 microversion: 2.1 time: 0.166444 Jul 04 05:56:59.344897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 233/455] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:59 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1707 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:56:59.352718 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a287c84d-1732-44f3-92be-b71990a2c8c0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:56:59.352718 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a287c84d-1732-44f3-92be-b71990a2c8c0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:56:59.358789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a287c84d-1732-44f3-92be-b71990a2c8c0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.359234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a287c84d-1732-44f3-92be-b71990a2c8c0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.360173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a287c84d-1732-44f3-92be-b71990a2c8c0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:56:59.360609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a287c84d-1732-44f3-92be-b71990a2c8c0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:56:59.447573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45c1b7ae-a176-45cf-b188-ffb739840c43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:59.459859 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45c1b7ae-a176-45cf-b188-ffb739840c43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1506 microversion: 2.1 time: 0.166104 Jul 04 05:56:59.460570 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 223/456] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:56:59 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:56:59.499807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a287c84d-1732-44f3-92be-b71990a2c8c0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:59.510415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a287c84d-1732-44f3-92be-b71990a2c8c0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:59.511944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a287c84d-1732-44f3-92be-b71990a2c8c0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:56:59.513150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a287c84d-1732-44f3-92be-b71990a2c8c0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.167303 Jul 04 05:56:59.521897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 234/457] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:56:59 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:57:00.222813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0bd1a714-840e-4101-a0f9-501c06dfc111 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:00.223392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0bd1a714-840e-4101-a0f9-501c06dfc111 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:00.230679 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bd1a714-840e-4101-a0f9-501c06dfc111 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:00.231433 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bd1a714-840e-4101-a0f9-501c06dfc111 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:00.232202 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bd1a714-840e-4101-a0f9-501c06dfc111 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:00.232638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bd1a714-840e-4101-a0f9-501c06dfc111 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:00.362362 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-acb81186-c1fc-4d30-b9a5-cda9dd69a090 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:00.363463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-acb81186-c1fc-4d30-b9a5-cda9dd69a090 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:00.370091 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-acb81186-c1fc-4d30-b9a5-cda9dd69a090 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:00.370544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-acb81186-c1fc-4d30-b9a5-cda9dd69a090 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:00.371352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-acb81186-c1fc-4d30-b9a5-cda9dd69a090 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:00.371791 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-acb81186-c1fc-4d30-b9a5-cda9dd69a090 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:00.378258 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0bd1a714-840e-4101-a0f9-501c06dfc111 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:00.386091 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0bd1a714-840e-4101-a0f9-501c06dfc111 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1504 microversion: 2.1 time: 0.167315 Jul 04 05:57:00.386624 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 224/458] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:00 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:00.477283 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3afeb4bb-b017-44c1-818b-b395612907cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:00.477988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3afeb4bb-b017-44c1-818b-b395612907cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:00.484781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3afeb4bb-b017-44c1-818b-b395612907cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:00.485617 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3afeb4bb-b017-44c1-818b-b395612907cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:00.486460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3afeb4bb-b017-44c1-818b-b395612907cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:00.488169 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3afeb4bb-b017-44c1-818b-b395612907cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:00.506656 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-acb81186-c1fc-4d30-b9a5-cda9dd69a090 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:00.516268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-acb81186-c1fc-4d30-b9a5-cda9dd69a090 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1711 microversion: 2.1 time: 0.157738 Jul 04 05:57:00.525304 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 235/459] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:00 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1711 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:57:00.531607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-032d03cb-4622-468e-ba43-ba52cfb03c14 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:00.532355 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-032d03cb-4622-468e-ba43-ba52cfb03c14 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:00.539025 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-032d03cb-4622-468e-ba43-ba52cfb03c14 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:00.539509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-032d03cb-4622-468e-ba43-ba52cfb03c14 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:00.540425 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-032d03cb-4622-468e-ba43-ba52cfb03c14 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:00.540884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-032d03cb-4622-468e-ba43-ba52cfb03c14 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:00.627695 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3afeb4bb-b017-44c1-818b-b395612907cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:00.635527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3afeb4bb-b017-44c1-818b-b395612907cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1506 microversion: 2.1 time: 0.162262 Jul 04 05:57:00.636275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 225/460] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:00 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:00.682193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-032d03cb-4622-468e-ba43-ba52cfb03c14 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:00.694887 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-032d03cb-4622-468e-ba43-ba52cfb03c14 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:00.697289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-032d03cb-4622-468e-ba43-ba52cfb03c14 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:00.699144 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-032d03cb-4622-468e-ba43-ba52cfb03c14 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.171316 Jul 04 05:57:00.700010 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 236/461] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:00 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:57:01.407144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-88876a28-0e2b-4020-850c-f6f28115e535 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:01.407950 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-88876a28-0e2b-4020-850c-f6f28115e535 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:01.418718 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88876a28-0e2b-4020-850c-f6f28115e535 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:01.419495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88876a28-0e2b-4020-850c-f6f28115e535 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:01.421020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88876a28-0e2b-4020-850c-f6f28115e535 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:01.421719 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88876a28-0e2b-4020-850c-f6f28115e535 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:01.566419 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-88876a28-0e2b-4020-850c-f6f28115e535 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:01.571912 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:01.578770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-88876a28-0e2b-4020-850c-f6f28115e535 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1504 microversion: 2.1 time: 0.177203 Jul 04 05:57:01.579678 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 226/462] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:01 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:01.653947 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7f99106d-1d95-4fcb-8b49-25e9b6dc2d47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:01.654689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7f99106d-1d95-4fcb-8b49-25e9b6dc2d47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:01.661958 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f99106d-1d95-4fcb-8b49-25e9b6dc2d47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:01.662452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f99106d-1d95-4fcb-8b49-25e9b6dc2d47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:01.663222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f99106d-1d95-4fcb-8b49-25e9b6dc2d47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:01.663775 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f99106d-1d95-4fcb-8b49-25e9b6dc2d47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:01.721357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9595c747-8c66-4dfb-bfc8-2fac929aad02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:01.721961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9595c747-8c66-4dfb-bfc8-2fac929aad02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:01.728961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9595c747-8c66-4dfb-bfc8-2fac929aad02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:01.729427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9595c747-8c66-4dfb-bfc8-2fac929aad02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:01.730197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9595c747-8c66-4dfb-bfc8-2fac929aad02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:01.730624 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9595c747-8c66-4dfb-bfc8-2fac929aad02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:01.802174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7f99106d-1d95-4fcb-8b49-25e9b6dc2d47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:01.808109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:01.813697 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7f99106d-1d95-4fcb-8b49-25e9b6dc2d47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1506 microversion: 2.1 time: 0.163658 Jul 04 05:57:01.822117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 237/463] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:01 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:01.876279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9595c747-8c66-4dfb-bfc8-2fac929aad02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:01.885224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9595c747-8c66-4dfb-bfc8-2fac929aad02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:01.886729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9595c747-8c66-4dfb-bfc8-2fac929aad02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:01.887962 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9595c747-8c66-4dfb-bfc8-2fac929aad02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.170619 Jul 04 05:57:01.889516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 227/464] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:01 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:57:02.600380 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-358f0eed-cff4-419c-bf96-0f0799f63a25 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:02.600992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-358f0eed-cff4-419c-bf96-0f0799f63a25 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:02.608028 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-358f0eed-cff4-419c-bf96-0f0799f63a25 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:02.608477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-358f0eed-cff4-419c-bf96-0f0799f63a25 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:02.609312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-358f0eed-cff4-419c-bf96-0f0799f63a25 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:02.609744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-358f0eed-cff4-419c-bf96-0f0799f63a25 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:02.745571 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-358f0eed-cff4-419c-bf96-0f0799f63a25 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:02.753741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-358f0eed-cff4-419c-bf96-0f0799f63a25 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1504 microversion: 2.1 time: 0.159550 Jul 04 05:57:02.754351 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 238/465] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:02 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:02.833357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c3b621bd-170a-43b9-9179-aeb252291339 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:02.834317 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c3b621bd-170a-43b9-9179-aeb252291339 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:02.841529 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3b621bd-170a-43b9-9179-aeb252291339 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:02.841972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3b621bd-170a-43b9-9179-aeb252291339 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:02.843042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3b621bd-170a-43b9-9179-aeb252291339 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:02.843225 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3b621bd-170a-43b9-9179-aeb252291339 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:02.906621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2fcf28e5-27ba-4754-978a-67c4db932ec6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:02.907559 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2fcf28e5-27ba-4754-978a-67c4db932ec6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:02.913748 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fcf28e5-27ba-4754-978a-67c4db932ec6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:02.914198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fcf28e5-27ba-4754-978a-67c4db932ec6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:02.914961 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fcf28e5-27ba-4754-978a-67c4db932ec6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:02.915432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fcf28e5-27ba-4754-978a-67c4db932ec6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:02.980045 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3b621bd-170a-43b9-9179-aeb252291339 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:02.987614 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c3b621bd-170a-43b9-9179-aeb252291339 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1506 microversion: 2.1 time: 0.160209 Jul 04 05:57:02.988290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 228/466] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:02 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:03.051239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2fcf28e5-27ba-4754-978a-67c4db932ec6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:03.060527 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2fcf28e5-27ba-4754-978a-67c4db932ec6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:03.062025 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2fcf28e5-27ba-4754-978a-67c4db932ec6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:03.063184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2fcf28e5-27ba-4754-978a-67c4db932ec6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.160707 Jul 04 05:57:03.063757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 239/467] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:02 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:57:03.773674 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-49669946-84cf-401f-abfd-a3963b1638a2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:03.774578 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-49669946-84cf-401f-abfd-a3963b1638a2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:03.783201 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49669946-84cf-401f-abfd-a3963b1638a2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:03.785276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49669946-84cf-401f-abfd-a3963b1638a2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:03.785276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49669946-84cf-401f-abfd-a3963b1638a2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:03.785276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49669946-84cf-401f-abfd-a3963b1638a2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:03.854962 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-01a634e0-f0b3-4324-a42f-1e27db14b8dc req-7f112539-825b-4ed9-8a75-5d37e7c3c730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf08277-34bd-4abc-b791-020400737f7e", "name": "network-vif-deleted", "tag": "cbf83c6a-9b07-4cfd-b772-2de8a2a1b628"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:03.865746 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-01a634e0-f0b3-4324-a42f-1e27db14b8dc req-7f112539-825b-4ed9-8a75-5d37e7c3c730 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:03.866638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-01a634e0-f0b3-4324-a42f-1e27db14b8dc req-7f112539-825b-4ed9-8a75-5d37e7c3c730 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:03.869437 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-49669946-84cf-401f-abfd-a3963b1638a2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:03.884662 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-49669946-84cf-401f-abfd-a3963b1638a2 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1462 microversion: 2.1 time: 0.112978 Jul 04 05:57:03.886510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 229/468] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:03 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1462 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:03.892753 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-01a634e0-f0b3-4324-a42f-1e27db14b8dc req-7f112539-825b-4ed9-8a75-5d37e7c3c730 service nova] Creating event network-vif-deleted:cbf83c6a-9b07-4cfd-b772-2de8a2a1b628 for instance 6bf08277-34bd-4abc-b791-020400737f7e on hv-cinder-79733 Jul 04 05:57:03.898808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-01a634e0-f0b3-4324-a42f-1e27db14b8dc req-7f112539-825b-4ed9-8a75-5d37e7c3c730 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047396 Jul 04 05:57:03.899768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 240/469] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:57:04.006184 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f10f8210-a013-4e5c-accb-11aab0e6b436 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:04.006853 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f10f8210-a013-4e5c-accb-11aab0e6b436 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:04.012880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f10f8210-a013-4e5c-accb-11aab0e6b436 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:04.013331 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f10f8210-a013-4e5c-accb-11aab0e6b436 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:04.014102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f10f8210-a013-4e5c-accb-11aab0e6b436 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:04.014698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f10f8210-a013-4e5c-accb-11aab0e6b436 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:04.082154 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ca4f29f3-99ee-414b-a9e7-44c612bca765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:04.082947 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ca4f29f3-99ee-414b-a9e7-44c612bca765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:04.090405 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca4f29f3-99ee-414b-a9e7-44c612bca765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:04.091110 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca4f29f3-99ee-414b-a9e7-44c612bca765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:04.092166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca4f29f3-99ee-414b-a9e7-44c612bca765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:04.092773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca4f29f3-99ee-414b-a9e7-44c612bca765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:04.159174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f10f8210-a013-4e5c-accb-11aab0e6b436 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:04.168385 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f10f8210-a013-4e5c-accb-11aab0e6b436 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1506 microversion: 2.1 time: 0.166015 Jul 04 05:57:04.169586 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 230/470] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:04 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:04.280728 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca4f29f3-99ee-414b-a9e7-44c612bca765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:04.289573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca4f29f3-99ee-414b-a9e7-44c612bca765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:04.291071 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca4f29f3-99ee-414b-a9e7-44c612bca765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:04.292302 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ca4f29f3-99ee-414b-a9e7-44c612bca765 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.214423 Jul 04 05:57:04.292857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 241/471] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:04 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:57:04.904685 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e10295d-199b-4212-b074-038ca3a5e92a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:04.905262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e10295d-199b-4212-b074-038ca3a5e92a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:04.914052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e10295d-199b-4212-b074-038ca3a5e92a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:04.914507 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e10295d-199b-4212-b074-038ca3a5e92a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:04.915273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e10295d-199b-4212-b074-038ca3a5e92a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:04.915731 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e10295d-199b-4212-b074-038ca3a5e92a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:04.947237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e10295d-199b-4212-b074-038ca3a5e92a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:04.947724 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e10295d-199b-4212-b074-038ca3a5e92a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:04.948178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-6e10295d-199b-4212-b074-038ca3a5e92a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lazy-loading 'fault' on Instance uuid 6bf08277-34bd-4abc-b791-020400737f7e {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:57:04.992873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6e10295d-199b-4212-b074-038ca3a5e92a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:05.000863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e10295d-199b-4212-b074-038ca3a5e92a tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1304 microversion: 2.1 time: 0.102396 Jul 04 05:57:05.001446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 231/472] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:04 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:05.189799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2581c476-b455-42d5-9e87-376b1aa7216e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:05.190549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2581c476-b455-42d5-9e87-376b1aa7216e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:05.199060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2581c476-b455-42d5-9e87-376b1aa7216e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:05.199709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2581c476-b455-42d5-9e87-376b1aa7216e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:05.200735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2581c476-b455-42d5-9e87-376b1aa7216e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:05.201311 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2581c476-b455-42d5-9e87-376b1aa7216e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:05.311532 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-99c0309b-a62a-49d8-a3d6-2dcd6b37c8ac tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:05.312412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-99c0309b-a62a-49d8-a3d6-2dcd6b37c8ac tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:05.320238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99c0309b-a62a-49d8-a3d6-2dcd6b37c8ac tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:05.320731 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99c0309b-a62a-49d8-a3d6-2dcd6b37c8ac tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:05.321550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99c0309b-a62a-49d8-a3d6-2dcd6b37c8ac tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:05.322037 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99c0309b-a62a-49d8-a3d6-2dcd6b37c8ac tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:05.345990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2581c476-b455-42d5-9e87-376b1aa7216e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:05.353471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2581c476-b455-42d5-9e87-376b1aa7216e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1506 microversion: 2.1 time: 0.169383 Jul 04 05:57:05.354249 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 242/473] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:05 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:05.456922 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99c0309b-a62a-49d8-a3d6-2dcd6b37c8ac tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:05.466092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99c0309b-a62a-49d8-a3d6-2dcd6b37c8ac tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:05.468125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99c0309b-a62a-49d8-a3d6-2dcd6b37c8ac tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:05.469390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-99c0309b-a62a-49d8-a3d6-2dcd6b37c8ac tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.161839 Jul 04 05:57:05.470155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 232/474] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:05 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:57:06.018123 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-24555265-f410-4e13-8fd2-dbfe3b566e2f tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:06.018734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-24555265-f410-4e13-8fd2-dbfe3b566e2f tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:06.025258 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24555265-f410-4e13-8fd2-dbfe3b566e2f tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:06.025700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24555265-f410-4e13-8fd2-dbfe3b566e2f tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:06.026459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24555265-f410-4e13-8fd2-dbfe3b566e2f tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:06.026888 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24555265-f410-4e13-8fd2-dbfe3b566e2f tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:06.058222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24555265-f410-4e13-8fd2-dbfe3b566e2f tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:06.058571 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24555265-f410-4e13-8fd2-dbfe3b566e2f tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:06.059022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-24555265-f410-4e13-8fd2-dbfe3b566e2f tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lazy-loading 'fault' on Instance uuid 6bf08277-34bd-4abc-b791-020400737f7e {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:57:06.107743 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-24555265-f410-4e13-8fd2-dbfe3b566e2f tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd9a1603e2340eba37ae8699f40b9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9a610826bc47b395a26f07ad375965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:06.115604 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-24555265-f410-4e13-8fd2-dbfe3b566e2f tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 200 len: 1304 microversion: 2.1 time: 0.101333 Jul 04 05:57:06.116337 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 243/475] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:06 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:06.370078 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-83141f0d-daf1-461b-87b4-69b3ddc033d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:06.370684 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-83141f0d-daf1-461b-87b4-69b3ddc033d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:06.377351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83141f0d-daf1-461b-87b4-69b3ddc033d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:06.377892 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83141f0d-daf1-461b-87b4-69b3ddc033d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:06.378703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83141f0d-daf1-461b-87b4-69b3ddc033d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:06.379127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83141f0d-daf1-461b-87b4-69b3ddc033d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:06.489657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d8f1ac0a-1f00-4a56-870e-3b56742dbbc8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:06.490389 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d8f1ac0a-1f00-4a56-870e-3b56742dbbc8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:06.500438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8f1ac0a-1f00-4a56-870e-3b56742dbbc8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:06.503364 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8f1ac0a-1f00-4a56-870e-3b56742dbbc8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:06.504533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8f1ac0a-1f00-4a56-870e-3b56742dbbc8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:06.513885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8f1ac0a-1f00-4a56-870e-3b56742dbbc8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:06.523721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-83141f0d-daf1-461b-87b4-69b3ddc033d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:06.533922 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-83141f0d-daf1-461b-87b4-69b3ddc033d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1506 microversion: 2.1 time: 0.167625 Jul 04 05:57:06.540568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 233/476] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:06 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:06.811877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-75a3330f-c1a1-4ab9-a906-5d137866dd68 req-8c97a14b-c2f5-4fb5-ac1e-771c45c6283e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178121f0-a865-467e-a46a-069b621b6d17", "name": "network-vif-plugged", "status": "completed", "tag": "27020a65-ee8e-4790-a27b-3983dfc85818"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:06.820929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-75a3330f-c1a1-4ab9-a906-5d137866dd68 req-8c97a14b-c2f5-4fb5-ac1e-771c45c6283e service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:06.821448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-75a3330f-c1a1-4ab9-a906-5d137866dd68 req-8c97a14b-c2f5-4fb5-ac1e-771c45c6283e service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:06.841653 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-75a3330f-c1a1-4ab9-a906-5d137866dd68 req-8c97a14b-c2f5-4fb5-ac1e-771c45c6283e service nova] Creating event network-vif-plugged:27020a65-ee8e-4790-a27b-3983dfc85818 for instance 178121f0-a865-467e-a46a-069b621b6d17 on hv-cinder-79733 Jul 04 05:57:06.847358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-75a3330f-c1a1-4ab9-a906-5d137866dd68 req-8c97a14b-c2f5-4fb5-ac1e-771c45c6283e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039304 Jul 04 05:57:06.848515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 234/477] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:06.950794 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d8f1ac0a-1f00-4a56-870e-3b56742dbbc8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:06.960929 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d8f1ac0a-1f00-4a56-870e-3b56742dbbc8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:06.962468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d8f1ac0a-1f00-4a56-870e-3b56742dbbc8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:06.963687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d8f1ac0a-1f00-4a56-870e-3b56742dbbc8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.479702 Jul 04 05:57:06.964248 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 244/478] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:06 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:57:07.134997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75f57593-c414-4395-acd4-435c743901e5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:07.135212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-75f57593-c414-4395-acd4-435c743901e5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] [instance: 6bf08277-34bd-4abc-b791-020400737f7e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:07.148636 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75f57593-c414-4395-acd4-435c743901e5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:07.149186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75f57593-c414-4395-acd4-435c743901e5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:07.150043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75f57593-c414-4395-acd4-435c743901e5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:07.150866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75f57593-c414-4395-acd4-435c743901e5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:07.166707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-75f57593-c414-4395-acd4-435c743901e5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] HTTP exception thrown: Instance 6bf08277-34bd-4abc-b791-020400737f7e could not be found. Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75f57593-c414-4395-acd4-435c743901e5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Request method failure captured: Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e HTTP/1.1 Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoDtODDzt9_k36xMxw26K653OomaIui47Eoabcf-psPU8BQVvVDfpQMRl8U0avIX3RlnAgyosfK0pCQDrXxyEky0eG0sQEvKEh7jgur9cfIy1syPkprimYKNapfxul39YOYCcex7RIazXbiQe27u2B_8gJYQnh5LZYol-tMSXz9JaNA Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: ee9a610826bc47b395a26f07ad375965 Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesActionsTest-2134443740 Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 05:57:07.168646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ee9a610826bc47b395a26f07ad375965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ee9a610826bc47b395a26f07ad375965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ee9a610826bc47b395a26f07ad375965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ee9a610826bc47b395a26f07ad375965"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesActionsTest-2134443740 Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: ee9a610826bc47b395a26f07ad375965 Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesActionsTest-2134443740 Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesActionsTest-2134443740-project Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 9dd9a1603e2340eba37ae8699f40b9f6 Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesActionsTest-2134443740-project Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 6bf08277-34bd-4abc-b791-020400737f7e could not be found. Jul 04 05:57:07.170985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '6bf08277-34bd-4abc-b791-020400737f7e'} Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf08277-34bd-4abc-b791-020400737f7e could not be found. Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:57:07.171940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf08277-34bd-4abc-b791-020400737f7e could not be found. Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf08277-34bd-4abc-b791-020400737f7e could not be found. Jul 04 05:57:07.173364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:57:07.174677 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75f57593-c414-4395-acd4-435c743901e5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] Returning 404 to user: Instance 6bf08277-34bd-4abc-b791-020400737f7e could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:57:07.174677 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-75f57593-c414-4395-acd4-435c743901e5 tempest-VolumesActionsTest-2134443740 tempest-VolumesActionsTest-2134443740-project] 10.222.0.42 "GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e" status: 404 len: 111 microversion: 2.1 time: 0.040345 Jul 04 05:57:07.174677 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 235/479] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:07 2022] GET /compute/v2.1/servers/6bf08277-34bd-4abc-b791-020400737f7e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:57:07.552214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-966439b8-32d4-4caa-aa32-3a674e38c85e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:07.553344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-966439b8-32d4-4caa-aa32-3a674e38c85e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:07.560367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-966439b8-32d4-4caa-aa32-3a674e38c85e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:07.560826 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-966439b8-32d4-4caa-aa32-3a674e38c85e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:07.561598 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-966439b8-32d4-4caa-aa32-3a674e38c85e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:07.562017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-966439b8-32d4-4caa-aa32-3a674e38c85e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:07.713391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-966439b8-32d4-4caa-aa32-3a674e38c85e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:07.721653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-966439b8-32d4-4caa-aa32-3a674e38c85e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1512 microversion: 2.1 time: 0.173774 Jul 04 05:57:07.722233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 245/480] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:07 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:07.984766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8eeb64d3-a636-4f16-8de0-34fd0f1b0f8b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:07.985375 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8eeb64d3-a636-4f16-8de0-34fd0f1b0f8b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:08.006521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eeb64d3-a636-4f16-8de0-34fd0f1b0f8b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:08.008332 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eeb64d3-a636-4f16-8de0-34fd0f1b0f8b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:08.009321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eeb64d3-a636-4f16-8de0-34fd0f1b0f8b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:08.011592 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eeb64d3-a636-4f16-8de0-34fd0f1b0f8b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:08.155461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8eeb64d3-a636-4f16-8de0-34fd0f1b0f8b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:08.164191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8eeb64d3-a636-4f16-8de0-34fd0f1b0f8b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:08.165638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8eeb64d3-a636-4f16-8de0-34fd0f1b0f8b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:08.166819 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8eeb64d3-a636-4f16-8de0-34fd0f1b0f8b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.188327 Jul 04 05:57:08.167416 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 236/481] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:07 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:57:09.190423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d85b7221-7974-4c3a-98d7-21490702831d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:09.191049 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d85b7221-7974-4c3a-98d7-21490702831d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:09.198051 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d85b7221-7974-4c3a-98d7-21490702831d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:09.198504 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d85b7221-7974-4c3a-98d7-21490702831d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:09.199287 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d85b7221-7974-4c3a-98d7-21490702831d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:09.199726 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d85b7221-7974-4c3a-98d7-21490702831d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:09.333233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d85b7221-7974-4c3a-98d7-21490702831d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:09.342057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d85b7221-7974-4c3a-98d7-21490702831d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:09.343594 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d85b7221-7974-4c3a-98d7-21490702831d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:09.344761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d85b7221-7974-4c3a-98d7-21490702831d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.162711 Jul 04 05:57:09.345301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 246/482] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:09 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:57:10.363565 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6dadafd-f324-4bf6-837b-78dc03575c42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:10.364186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e6dadafd-f324-4bf6-837b-78dc03575c42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:10.371364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6dadafd-f324-4bf6-837b-78dc03575c42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:10.371812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6dadafd-f324-4bf6-837b-78dc03575c42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:10.372572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6dadafd-f324-4bf6-837b-78dc03575c42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:10.372997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6dadafd-f324-4bf6-837b-78dc03575c42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:10.509490 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6dadafd-f324-4bf6-837b-78dc03575c42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:10.518752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6dadafd-f324-4bf6-837b-78dc03575c42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:10.521007 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6dadafd-f324-4bf6-837b-78dc03575c42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:10.522356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e6dadafd-f324-4bf6-837b-78dc03575c42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.162745 Jul 04 05:57:10.522917 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 237/483] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:10 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:57:11.542524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c75cad7d-e23c-4ed8-bfc4-2d942b9606da tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:11.543105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c75cad7d-e23c-4ed8-bfc4-2d942b9606da tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:11.549727 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c75cad7d-e23c-4ed8-bfc4-2d942b9606da tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:11.550176 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c75cad7d-e23c-4ed8-bfc4-2d942b9606da tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:11.550940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c75cad7d-e23c-4ed8-bfc4-2d942b9606da tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:11.551372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c75cad7d-e23c-4ed8-bfc4-2d942b9606da tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:11.688936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c75cad7d-e23c-4ed8-bfc4-2d942b9606da tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:11.698809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c75cad7d-e23c-4ed8-bfc4-2d942b9606da tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:11.700346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c75cad7d-e23c-4ed8-bfc4-2d942b9606da tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:11.701552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c75cad7d-e23c-4ed8-bfc4-2d942b9606da tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.163079 Jul 04 05:57:11.702101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 247/484] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:11 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:57:12.268569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-90479f5c-6123-4c63-ba10-8e8e05584350 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'create', calling method: .version_select at 0x7f20477121f0>, body: {"keypair": {"name": "tempest-keypair-1812064032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHNN+ggNFfPwZHlmhg+fMWsNCQbom1Xc+FRfw6rw12b6WrHlMGUPRMsmqzipK0ImqXMn9be1eUG38D3hBc3WikGpOHAMU/obpXEJz2StZ3wFsbhGJsXIJOdtro7/OxgYA=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:12.284257 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-90479f5c-6123-4c63-ba10-8e8e05584350 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Getting quotas for project 27aa4fc6d2bd46d3a3492cf0b1d7ae9d. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:57:12.288272 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-90479f5c-6123-4c63-ba10-8e8e05584350 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Getting quotas for user 93ae888c6e364e2e96ff52e63415a0e5 and project 27aa4fc6d2bd46d3a3492cf0b1d7ae9d. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:57:12.300821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR oslo.messaging._drivers.impl_rabbit [None req-90479f5c-6123-4c63-ba10-8e8e05584350 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [a6522c6f-107f-4cf8-a340-b761d2ae0e6e] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 04 05:57:12.722100 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3b8f21e3-a720-4886-854b-cda350dbbb34 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:12.722688 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3b8f21e3-a720-4886-854b-cda350dbbb34 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:12.729417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b8f21e3-a720-4886-854b-cda350dbbb34 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:12.729868 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b8f21e3-a720-4886-854b-cda350dbbb34 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:12.730641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b8f21e3-a720-4886-854b-cda350dbbb34 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:12.731068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b8f21e3-a720-4886-854b-cda350dbbb34 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:12.874307 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3b8f21e3-a720-4886-854b-cda350dbbb34 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:12.887115 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3b8f21e3-a720-4886-854b-cda350dbbb34 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:12.888784 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3b8f21e3-a720-4886-854b-cda350dbbb34 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:12.890772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3b8f21e3-a720-4886-854b-cda350dbbb34 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1807 microversion: 2.20 time: 0.174034 Jul 04 05:57:12.891955 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 248/485] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:12 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:57:13.312170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [None req-90479f5c-6123-4c63-ba10-8e8e05584350 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [a6522c6f-107f-4cf8-a340-b761d2ae0e6e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 48544. Jul 04 05:57:13.330243 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-90479f5c-6123-4c63-ba10-8e8e05584350 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.065486 Jul 04 05:57:13.331192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 238/486] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jul 4 05:57:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:13.910420 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2fbb7e77-6ee3-4ab9-8329-7e0044ae224c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:13.911329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2fbb7e77-6ee3-4ab9-8329-7e0044ae224c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:13.921421 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbb7e77-6ee3-4ab9-8329-7e0044ae224c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:13.923181 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbb7e77-6ee3-4ab9-8329-7e0044ae224c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:13.925176 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbb7e77-6ee3-4ab9-8329-7e0044ae224c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:13.926151 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbb7e77-6ee3-4ab9-8329-7e0044ae224c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:14.214163 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2fbb7e77-6ee3-4ab9-8329-7e0044ae224c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:14.224911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2fbb7e77-6ee3-4ab9-8329-7e0044ae224c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:14.227045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2fbb7e77-6ee3-4ab9-8329-7e0044ae224c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:14.228378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2fbb7e77-6ee3-4ab9-8329-7e0044ae224c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1794 microversion: 2.20 time: 0.322644 Jul 04 05:57:14.229160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 249/487] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:57:13 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1794 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:57:14.963873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2125901901", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a973c6df-b27b-4426-b61c-9570a0a82fe2"}], "security_groups": [{"name": "tempest-securitygroup--149802390"}], "key_name": "tempest-keypair-1812064032", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:15.083281 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] validate_networks() for [('a973c6df-b27b-4426-b61c-9570a0a82fe2', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:57:15.507840 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:57:15.508183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:57:15.508690 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:57:15.509094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:57:15.509506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:57:15.519646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:15.520365 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:15.522202 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:15.522803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:15.540795 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Getting quotas for project 27aa4fc6d2bd46d3a3492cf0b1d7ae9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:57:15.545132 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Getting quotas for user 93ae888c6e364e2e96ff52e63415a0e5 and project 27aa4fc6d2bd46d3a3492cf0b1d7ae9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:57:15.557156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:57:15.559767 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:57:15.620885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a28f991f-8145-4a5e-a29d-23cb11b97b78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.661441 Jul 04 05:57:15.622160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 239/488] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:57:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:57:15.633182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-69e65b8d-c3eb-49d1-88bd-5fed532b248d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:15.634556 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-69e65b8d-c3eb-49d1-88bd-5fed532b248d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:15.713037 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-69e65b8d-c3eb-49d1-88bd-5fed532b248d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:15.721622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-69e65b8d-c3eb-49d1-88bd-5fed532b248d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1246 microversion: 2.1 time: 0.092478 Jul 04 05:57:15.722692 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 250/489] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:16.740294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-19ca0c49-df65-4d8a-9e1c-259fba85dd7e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:16.741159 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-19ca0c49-df65-4d8a-9e1c-259fba85dd7e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:16.749242 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19ca0c49-df65-4d8a-9e1c-259fba85dd7e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:16.750165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19ca0c49-df65-4d8a-9e1c-259fba85dd7e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:16.751456 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19ca0c49-df65-4d8a-9e1c-259fba85dd7e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:16.752002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19ca0c49-df65-4d8a-9e1c-259fba85dd7e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:16.856769 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-19ca0c49-df65-4d8a-9e1c-259fba85dd7e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:16.868276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-19ca0c49-df65-4d8a-9e1c-259fba85dd7e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1298 microversion: 2.1 time: 0.133541 Jul 04 05:57:16.869979 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 240/490] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1298 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:57:17.566369 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f948ff86-949f-48bc-b041-8e490c3788d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9114d534-f4de-4d46-9955-51ed93ac2662", "device": "/dev/sdb"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:17.569632 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f948ff86-949f-48bc-b041-8e490c3788d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:17.579565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f948ff86-949f-48bc-b041-8e490c3788d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:17.580573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f948ff86-949f-48bc-b041-8e490c3788d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:17.582515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f948ff86-949f-48bc-b041-8e490c3788d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:17.583236 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f948ff86-949f-48bc-b041-8e490c3788d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:17.887426 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e665f91a-4224-4cd1-92b1-95fcc5e09f2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:17.888032 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e665f91a-4224-4cd1-92b1-95fcc5e09f2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:17.900447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e665f91a-4224-4cd1-92b1-95fcc5e09f2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:17.901149 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e665f91a-4224-4cd1-92b1-95fcc5e09f2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:17.902133 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e665f91a-4224-4cd1-92b1-95fcc5e09f2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:17.902715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e665f91a-4224-4cd1-92b1-95fcc5e09f2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:17.979377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f948ff86-949f-48bc-b041-8e490c3788d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "POST /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425323 Jul 04 05:57:17.980649 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 251/491] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jul 4 05:57:17 2022] POST /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:18.146965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e665f91a-4224-4cd1-92b1-95fcc5e09f2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:18.158093 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e665f91a-4224-4cd1-92b1-95fcc5e09f2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1371 microversion: 2.1 time: 0.275018 Jul 04 05:57:18.159288 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 241/492] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:18.752323 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-a99c1790-504d-428b-8644-d7930ed3cd3f req-1e9eb32d-3983-40e8-835d-8442b1707a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6141b5a5-5e40-4d2e-afb1-ff85c45f0620", "tag": "1015e693-9c03-489d-bc15-506c5f4f1b3b"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:18.771395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=88 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:18.778398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a99c1790-504d-428b-8644-d7930ed3cd3f req-1e9eb32d-3983-40e8-835d-8442b1707a62 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:18.784882 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a99c1790-504d-428b-8644-d7930ed3cd3f req-1e9eb32d-3983-40e8-835d-8442b1707a62 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:18.809212 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-a99c1790-504d-428b-8644-d7930ed3cd3f req-1e9eb32d-3983-40e8-835d-8442b1707a62 service nova] Creating event network-changed:1015e693-9c03-489d-bc15-506c5f4f1b3b for instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 on hv-cinder-79733 Jul 04 05:57:18.827539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-a99c1790-504d-428b-8644-d7930ed3cd3f req-1e9eb32d-3983-40e8-835d-8442b1707a62 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081066 Jul 04 05:57:18.828967 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 252/493] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:57:19.178056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cb4feb81-191c-4533-8e4e-e87c14429d38 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:19.179321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cb4feb81-191c-4533-8e4e-e87c14429d38 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:19.187645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb4feb81-191c-4533-8e4e-e87c14429d38 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:19.188312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb4feb81-191c-4533-8e4e-e87c14429d38 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:19.190077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb4feb81-191c-4533-8e4e-e87c14429d38 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:19.190836 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb4feb81-191c-4533-8e4e-e87c14429d38 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:19.388152 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cb4feb81-191c-4533-8e4e-e87c14429d38 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:19.396977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cb4feb81-191c-4533-8e4e-e87c14429d38 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1371 microversion: 2.1 time: 0.224084 Jul 04 05:57:19.406981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 242/494] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:20.415182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ee34b66-4db7-4c53-a8fe-1e78b06da954 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:20.415838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8ee34b66-4db7-4c53-a8fe-1e78b06da954 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:20.423443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ee34b66-4db7-4c53-a8fe-1e78b06da954 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:20.423889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ee34b66-4db7-4c53-a8fe-1e78b06da954 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:20.424695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ee34b66-4db7-4c53-a8fe-1e78b06da954 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:20.425117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ee34b66-4db7-4c53-a8fe-1e78b06da954 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:20.622759 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ee34b66-4db7-4c53-a8fe-1e78b06da954 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:20.632940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ee34b66-4db7-4c53-a8fe-1e78b06da954 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1371 microversion: 2.1 time: 0.222465 Jul 04 05:57:20.634507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 253/495] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:20 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:21.650555 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3bce41c3-6168-4d8c-aae0-4db8598017b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:21.651947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3bce41c3-6168-4d8c-aae0-4db8598017b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:21.660910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bce41c3-6168-4d8c-aae0-4db8598017b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:21.661355 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bce41c3-6168-4d8c-aae0-4db8598017b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:21.662129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bce41c3-6168-4d8c-aae0-4db8598017b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:21.662555 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bce41c3-6168-4d8c-aae0-4db8598017b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:21.810336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3bce41c3-6168-4d8c-aae0-4db8598017b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:21.819192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3bce41c3-6168-4d8c-aae0-4db8598017b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1371 microversion: 2.1 time: 0.172904 Jul 04 05:57:21.819967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 243/496] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:22.839758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-83d771da-99d9-4894-9bca-0f92f895029b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:22.841344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-83d771da-99d9-4894-9bca-0f92f895029b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:22.849614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83d771da-99d9-4894-9bca-0f92f895029b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:22.850454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83d771da-99d9-4894-9bca-0f92f895029b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:22.854324 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83d771da-99d9-4894-9bca-0f92f895029b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:22.855144 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83d771da-99d9-4894-9bca-0f92f895029b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:22.912874 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a44dbabc-cee4-4b59-8bb7-69a8ea2348b8 req-554eed17-6635-49d8-a41f-555d83bb1050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6141b5a5-5e40-4d2e-afb1-ff85c45f0620", "name": "network-vif-plugged", "status": "completed", "tag": "1015e693-9c03-489d-bc15-506c5f4f1b3b"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:22.951574 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a44dbabc-cee4-4b59-8bb7-69a8ea2348b8 req-554eed17-6635-49d8-a41f-555d83bb1050 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:22.953042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a44dbabc-cee4-4b59-8bb7-69a8ea2348b8 req-554eed17-6635-49d8-a41f-555d83bb1050 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:22.977391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a44dbabc-cee4-4b59-8bb7-69a8ea2348b8 req-554eed17-6635-49d8-a41f-555d83bb1050 service nova] Creating event network-vif-plugged:1015e693-9c03-489d-bc15-506c5f4f1b3b for instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 on hv-cinder-79733 Jul 04 05:57:22.985239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a44dbabc-cee4-4b59-8bb7-69a8ea2348b8 req-554eed17-6635-49d8-a41f-555d83bb1050 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074683 Jul 04 05:57:22.987717 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 244/497] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:23.075696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-83d771da-99d9-4894-9bca-0f92f895029b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:23.085013 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-83d771da-99d9-4894-9bca-0f92f895029b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1371 microversion: 2.1 time: 0.252269 Jul 04 05:57:23.085680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 254/498] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:24.104821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6de696d6-b513-4b22-b47d-6ac53530966f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:24.105544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6de696d6-b513-4b22-b47d-6ac53530966f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:24.112781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de696d6-b513-4b22-b47d-6ac53530966f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:24.113233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de696d6-b513-4b22-b47d-6ac53530966f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:24.114021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de696d6-b513-4b22-b47d-6ac53530966f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:24.114454 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6de696d6-b513-4b22-b47d-6ac53530966f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:24.256261 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6de696d6-b513-4b22-b47d-6ac53530966f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:24.265164 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6de696d6-b513-4b22-b47d-6ac53530966f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1371 microversion: 2.1 time: 0.164572 Jul 04 05:57:24.265836 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 245/499] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:25.287063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-be8eba8b-8e4f-4b12-aa48-9a325ce5e32f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:25.288483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-be8eba8b-8e4f-4b12-aa48-9a325ce5e32f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:25.300309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be8eba8b-8e4f-4b12-aa48-9a325ce5e32f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:25.301349 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be8eba8b-8e4f-4b12-aa48-9a325ce5e32f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:25.302606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be8eba8b-8e4f-4b12-aa48-9a325ce5e32f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:25.303352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be8eba8b-8e4f-4b12-aa48-9a325ce5e32f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:25.348753 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:25.497621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-be8eba8b-8e4f-4b12-aa48-9a325ce5e32f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:25.508711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-be8eba8b-8e4f-4b12-aa48-9a325ce5e32f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1371 microversion: 2.1 time: 0.228735 Jul 04 05:57:25.510022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 255/500] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:26.526271 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba44f27f-1df1-4a4c-a3fb-152e8f55cd81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:26.527017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba44f27f-1df1-4a4c-a3fb-152e8f55cd81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:26.533080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:26.534029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=10 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:26.536053 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba44f27f-1df1-4a4c-a3fb-152e8f55cd81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:26.536865 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba44f27f-1df1-4a4c-a3fb-152e8f55cd81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:26.538027 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba44f27f-1df1-4a4c-a3fb-152e8f55cd81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:26.538855 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba44f27f-1df1-4a4c-a3fb-152e8f55cd81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:26.698489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ba44f27f-1df1-4a4c-a3fb-152e8f55cd81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:26.703174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:26.710771 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba44f27f-1df1-4a4c-a3fb-152e8f55cd81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1563 microversion: 2.1 time: 0.188689 Jul 04 05:57:26.711403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 246/501] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:26.729576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-08fdc7cd-7522-4bd7-94cf-c0e71d8614ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:26.730661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-08fdc7cd-7522-4bd7-94cf-c0e71d8614ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:26.733905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:26.738996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08fdc7cd-7522-4bd7-94cf-c0e71d8614ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:26.739610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08fdc7cd-7522-4bd7-94cf-c0e71d8614ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:26.741037 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08fdc7cd-7522-4bd7-94cf-c0e71d8614ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:26.741584 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08fdc7cd-7522-4bd7-94cf-c0e71d8614ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:26.836138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-08fdc7cd-7522-4bd7-94cf-c0e71d8614ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112153 Jul 04 05:57:26.836825 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 256/502] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jul 4 05:57:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:57:27.865029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-2619d90c-020d-458e-85dc-c2a2a1e91a3c req-b5f38720-edc9-4c54-8cdc-407552c3023f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6141b5a5-5e40-4d2e-afb1-ff85c45f0620", "tag": "1015e693-9c03-489d-bc15-506c5f4f1b3b"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:27.883817 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:27.891505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-2619d90c-020d-458e-85dc-c2a2a1e91a3c req-b5f38720-edc9-4c54-8cdc-407552c3023f service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:27.892656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-2619d90c-020d-458e-85dc-c2a2a1e91a3c req-b5f38720-edc9-4c54-8cdc-407552c3023f service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:27.937610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-2619d90c-020d-458e-85dc-c2a2a1e91a3c req-b5f38720-edc9-4c54-8cdc-407552c3023f service nova] Creating event network-changed:1015e693-9c03-489d-bc15-506c5f4f1b3b for instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 on hv-cinder-79733 Jul 04 05:57:27.949885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-2619d90c-020d-458e-85dc-c2a2a1e91a3c req-b5f38720-edc9-4c54-8cdc-407552c3023f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088703 Jul 04 05:57:27.951929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 247/503] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:36.436643 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dcfd13c2-10ba-4dae-9834-c85b63566f34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:36.437731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dcfd13c2-10ba-4dae-9834-c85b63566f34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:36.447593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcfd13c2-10ba-4dae-9834-c85b63566f34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:36.448180 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcfd13c2-10ba-4dae-9834-c85b63566f34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:36.448971 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcfd13c2-10ba-4dae-9834-c85b63566f34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:36.449399 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcfd13c2-10ba-4dae-9834-c85b63566f34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:36.472612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dcfd13c2-10ba-4dae-9834-c85b63566f34 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b/ips" status: 200 len: 149 microversion: 2.1 time: 0.043849 Jul 04 05:57:36.473166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 257/504] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jul 4 05:57:36 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:36.485920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7bae0ad2-ed8f-4656-8748-100e8add9ee2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c29cf0e5-0c6c-4806-8032-3951d042d3d3"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:36.487153 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7bae0ad2-ed8f-4656-8748-100e8add9ee2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:36.494838 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bae0ad2-ed8f-4656-8748-100e8add9ee2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:36.495283 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bae0ad2-ed8f-4656-8748-100e8add9ee2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:36.496103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bae0ad2-ed8f-4656-8748-100e8add9ee2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:36.496539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bae0ad2-ed8f-4656-8748-100e8add9ee2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:36.581189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-7bae0ad2-ed8f-4656-8748-100e8add9ee2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Invalid volume: volume c29cf0e5-0c6c-4806-8032-3951d042d3d3 is already attached to instances: 91a604de-7fc4-4f6c-9fce-acd174439f47 Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7bae0ad2-ed8f-4656-8748-100e8add9ee2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b/os-volume_attachments HTTP/1.1 Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 74 Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 05:57:36.582908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {"volumeAttachment": {"volumeId": "c29cf0e5-0c6c-4806-8032-3951d042d3d3"}} Jul 04 05:57:36.584390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Invalid volume: volume c29cf0e5-0c6c-4806-8032-3951d042d3d3 is already attached to instances: 91a604de-7fc4-4f6c-9fce-acd174439f47 Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'server_id': '6e5a689e-ec6d-40f5-beeb-36326b13fb0b', 'body': {'volumeAttachment': {'volumeId': 'c29cf0e5-0c6c-4806-8032-3951d042d3d3'}}} Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c29cf0e5-0c6c-4806-8032-3951d042d3d3 is already attached to instances: 91a604de-7fc4-4f6c-9fce-acd174439f47 Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:57:36.585466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c29cf0e5-0c6c-4806-8032-3951d042d3d3 is already attached to instances: 91a604de-7fc4-4f6c-9fce-acd174439f47 Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:36.586913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:57:36.588452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:57:36.588452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:57:36.588452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:57:36.588452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c29cf0e5-0c6c-4806-8032-3951d042d3d3 is already attached to instances: 91a604de-7fc4-4f6c-9fce-acd174439f47 Jul 04 05:57:36.588452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:57:36.588452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7bae0ad2-ed8f-4656-8748-100e8add9ee2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 400 to user: Invalid volume: volume c29cf0e5-0c6c-4806-8032-3951d042d3d3 is already attached to instances: 91a604de-7fc4-4f6c-9fce-acd174439f47 {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:57:36.588452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7bae0ad2-ed8f-4656-8748-100e8add9ee2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "POST /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104117 Jul 04 05:57:36.588452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 248/505] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jul 4 05:57:36 2022] POST /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 05:57:36.593818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-265aca9b-a39f-4706-bae5-d39b81d362fa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:36.594344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-265aca9b-a39f-4706-bae5-d39b81d362fa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:36.600587 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-265aca9b-a39f-4706-bae5-d39b81d362fa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:36.601026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-265aca9b-a39f-4706-bae5-d39b81d362fa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:36.601778 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-265aca9b-a39f-4706-bae5-d39b81d362fa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:36.602204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-265aca9b-a39f-4706-bae5-d39b81d362fa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:36.626413 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-265aca9b-a39f-4706-bae5-d39b81d362fa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 05:57:36.717514 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-265aca9b-a39f-4706-bae5-d39b81d362fa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 204 len: 0 microversion: 2.1 time: 0.127068 Jul 04 05:57:36.718268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 258/506] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 05:57:36 2022] DELETE /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 05:57:36.726512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3e318956-ada6-419d-ac72-1d4309b28260 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:36.727127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3e318956-ada6-419d-ac72-1d4309b28260 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:36.734352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e318956-ada6-419d-ac72-1d4309b28260 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:36.734798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e318956-ada6-419d-ac72-1d4309b28260 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:36.735688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e318956-ada6-419d-ac72-1d4309b28260 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:36.736330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e318956-ada6-419d-ac72-1d4309b28260 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:36.871775 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3e318956-ada6-419d-ac72-1d4309b28260 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:36.882683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3e318956-ada6-419d-ac72-1d4309b28260 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1680 microversion: 2.1 time: 0.159859 Jul 04 05:57:36.883379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 249/507] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:36 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:37.911431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a3384ef9-5bec-4847-b354-3fd6389b5048 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:37.912501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a3384ef9-5bec-4847-b354-3fd6389b5048 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:37.923662 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3384ef9-5bec-4847-b354-3fd6389b5048 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:37.924111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3384ef9-5bec-4847-b354-3fd6389b5048 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:37.924881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3384ef9-5bec-4847-b354-3fd6389b5048 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:37.925316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3384ef9-5bec-4847-b354-3fd6389b5048 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:38.063651 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a3384ef9-5bec-4847-b354-3fd6389b5048 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:38.071858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a3384ef9-5bec-4847-b354-3fd6389b5048 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1680 microversion: 2.1 time: 0.167737 Jul 04 05:57:38.072429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 259/508] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:37 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:39.094140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a84d7498-5a3a-4ef0-8e8b-e9dbe6d2fb3a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:39.095047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a84d7498-5a3a-4ef0-8e8b-e9dbe6d2fb3a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:39.106164 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a84d7498-5a3a-4ef0-8e8b-e9dbe6d2fb3a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:39.106944 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a84d7498-5a3a-4ef0-8e8b-e9dbe6d2fb3a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:39.108401 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a84d7498-5a3a-4ef0-8e8b-e9dbe6d2fb3a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:39.109113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a84d7498-5a3a-4ef0-8e8b-e9dbe6d2fb3a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:39.255854 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a84d7498-5a3a-4ef0-8e8b-e9dbe6d2fb3a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:39.263752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a84d7498-5a3a-4ef0-8e8b-e9dbe6d2fb3a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1680 microversion: 2.1 time: 0.176662 Jul 04 05:57:39.264312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 250/509] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:39 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:40.285370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac259088-12ec-4b11-b3cf-3896252d47d8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:40.286373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ac259088-12ec-4b11-b3cf-3896252d47d8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:40.296340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac259088-12ec-4b11-b3cf-3896252d47d8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:40.296793 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac259088-12ec-4b11-b3cf-3896252d47d8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:40.297562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac259088-12ec-4b11-b3cf-3896252d47d8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:40.297996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac259088-12ec-4b11-b3cf-3896252d47d8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:40.433446 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ac259088-12ec-4b11-b3cf-3896252d47d8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:40.445289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ac259088-12ec-4b11-b3cf-3896252d47d8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1680 microversion: 2.1 time: 0.166170 Jul 04 05:57:40.446082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 260/510] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:40 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:41.464441 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-99874245-eaac-48d0-bb4a-dc82dc7761ad tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:41.465150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-99874245-eaac-48d0-bb4a-dc82dc7761ad tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:41.472123 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99874245-eaac-48d0-bb4a-dc82dc7761ad tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:41.472501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99874245-eaac-48d0-bb4a-dc82dc7761ad tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:41.473270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99874245-eaac-48d0-bb4a-dc82dc7761ad tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:41.473707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99874245-eaac-48d0-bb4a-dc82dc7761ad tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:41.607928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99874245-eaac-48d0-bb4a-dc82dc7761ad tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:41.615915 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-99874245-eaac-48d0-bb4a-dc82dc7761ad tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1680 microversion: 2.1 time: 0.155460 Jul 04 05:57:41.616484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 251/511] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:41 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:42.532869 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-44025616-70bd-429f-8f38-1a90ca1d366c req-81dd1574-5340-44d2-b244-b30bbbf0b2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5a689e-ec6d-40f5-beeb-36326b13fb0b", "name": "network-vif-deleted", "tag": "be2b55c5-eb0b-48a8-a754-efe9ce27c3a4"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:42.546516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-44025616-70bd-429f-8f38-1a90ca1d366c req-81dd1574-5340-44d2-b244-b30bbbf0b2c6 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:42.547140 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-44025616-70bd-429f-8f38-1a90ca1d366c req-81dd1574-5340-44d2-b244-b30bbbf0b2c6 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:42.579549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-44025616-70bd-429f-8f38-1a90ca1d366c req-81dd1574-5340-44d2-b244-b30bbbf0b2c6 service nova] Creating event network-vif-deleted:be2b55c5-eb0b-48a8-a754-efe9ce27c3a4 for instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b on hv-cinder-79733 Jul 04 05:57:42.586339 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-44025616-70bd-429f-8f38-1a90ca1d366c req-81dd1574-5340-44d2-b244-b30bbbf0b2c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058234 Jul 04 05:57:42.587659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 261/512] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:42.634313 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-df235dbe-d0ba-4a98-89c4-32d9387ea7db tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:42.634985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-df235dbe-d0ba-4a98-89c4-32d9387ea7db tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:42.646264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df235dbe-d0ba-4a98-89c4-32d9387ea7db tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:42.649431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df235dbe-d0ba-4a98-89c4-32d9387ea7db tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:42.650427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df235dbe-d0ba-4a98-89c4-32d9387ea7db tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:42.652871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df235dbe-d0ba-4a98-89c4-32d9387ea7db tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:42.763224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df235dbe-d0ba-4a98-89c4-32d9387ea7db tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:42.771964 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-df235dbe-d0ba-4a98-89c4-32d9387ea7db tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 200 len: 1325 microversion: 2.1 time: 0.141993 Jul 04 05:57:42.772455 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 252/513] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:42 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 1325 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:43.790486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a6750e13-22e7-4cce-a68f-b32c07675ab0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:43.791195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a6750e13-22e7-4cce-a68f-b32c07675ab0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:43.798458 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6750e13-22e7-4cce-a68f-b32c07675ab0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:43.798799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6750e13-22e7-4cce-a68f-b32c07675ab0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:43.799601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6750e13-22e7-4cce-a68f-b32c07675ab0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:43.800058 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6750e13-22e7-4cce-a68f-b32c07675ab0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:43.814401 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-a6750e13-22e7-4cce-a68f-b32c07675ab0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a6750e13-22e7-4cce-a68f-b32c07675ab0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b HTTP/1.1 Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:57:43.816310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 05:57:43.817851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '6e5a689e-ec6d-40f5-beeb-36326b13fb0b'} Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:57:43.818550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 05:57:43.819745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:43.821688 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a6750e13-22e7-4cce-a68f-b32c07675ab0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:57:43.822707 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a6750e13-22e7-4cce-a68f-b32c07675ab0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 404 len: 111 microversion: 2.1 time: 0.036936 Jul 04 05:57:43.826653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 262/514] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:43 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 05:57:43.837677 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2dc334c7-1e2c-4b98-9848-1c7621491d6f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '.version_select at 0x7f2047712e50>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:43.861906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2dc334c7-1e2c-4b98-9848-1c7621491d6f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-510214779" status: 202 len: 0 microversion: 2.1 time: 0.033326 Jul 04 05:57:43.862626 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 253/515] 10.222.0.42 () {58 vars in 1217 bytes} [Mon Jul 4 05:57:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-510214779 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:57:44.568899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-31a8c824-37d1-49a7-8b97-f8ea48d55c3f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:44.569406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-31a8c824-37d1-49a7-8b97-f8ea48d55c3f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:44.575715 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31a8c824-37d1-49a7-8b97-f8ea48d55c3f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:44.576139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31a8c824-37d1-49a7-8b97-f8ea48d55c3f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:44.576901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31a8c824-37d1-49a7-8b97-f8ea48d55c3f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:44.577317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31a8c824-37d1-49a7-8b97-f8ea48d55c3f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:44.714106 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-31a8c824-37d1-49a7-8b97-f8ea48d55c3f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lazy-loading 'services' on Instance uuid 91a604de-7fc4-4f6c-9fce-acd174439f47 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:57:44.835481 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-31a8c824-37d1-49a7-8b97-f8ea48d55c3f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments/c29cf0e5-0c6c-4806-8032-3951d042d3d3" status: 202 len: 0 microversion: 2.1 time: 0.270476 Jul 04 05:57:44.846358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0ef38c7a-0181-4605-b57f-42df761c18c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:44.847522 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0ef38c7a-0181-4605-b57f-42df761c18c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:44.852966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 263/516] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jul 4 05:57:44 2022] DELETE /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments/c29cf0e5-0c6c-4806-8032-3951d042d3d3 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:57:44.858362 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ef38c7a-0181-4605-b57f-42df761c18c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:44.859266 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ef38c7a-0181-4605-b57f-42df761c18c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:44.860426 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ef38c7a-0181-4605-b57f-42df761c18c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:44.861154 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ef38c7a-0181-4605-b57f-42df761c18c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:44.906713 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0ef38c7a-0181-4605-b57f-42df761c18c9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065651 Jul 04 05:57:44.907742 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 254/517] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 05:57:44 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:45.290494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c380145a-6617-4bb7-948f-684f41e0b3b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:45.291317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c380145a-6617-4bb7-948f-684f41e0b3b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:45.298252 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c380145a-6617-4bb7-948f-684f41e0b3b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:45.298695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c380145a-6617-4bb7-948f-684f41e0b3b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:45.299506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c380145a-6617-4bb7-948f-684f41e0b3b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:45.299942 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c380145a-6617-4bb7-948f-684f41e0b3b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:45.382877 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-c380145a-6617-4bb7-948f-684f41e0b3b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lazy-loading 'services' on Instance uuid 58f46f48-e103-480b-89aa-f3a9b0a01bc8 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:57:45.462138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c380145a-6617-4bb7-948f-684f41e0b3b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8/os-volume_attachments/9114d534-f4de-4d46-9955-51ed93ac2662" status: 202 len: 0 microversion: 2.1 time: 0.175895 Jul 04 05:57:45.462729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 264/518] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jul 4 05:57:45 2022] DELETE /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8/os-volume_attachments/9114d534-f4de-4d46-9955-51ed93ac2662 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:57:45.923035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c4a3a6c-9d79-4d0f-beb9-c96e24f734b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:45.924419 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9c4a3a6c-9d79-4d0f-beb9-c96e24f734b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:45.934967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a6c-9d79-4d0f-beb9-c96e24f734b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:45.935447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a6c-9d79-4d0f-beb9-c96e24f734b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:45.936212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a6c-9d79-4d0f-beb9-c96e24f734b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:45.936646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a6c-9d79-4d0f-beb9-c96e24f734b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:45.966039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9c4a3a6c-9d79-4d0f-beb9-c96e24f734b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050278 Jul 04 05:57:45.966604 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 255/519] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 05:57:45 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:46.983062 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a5cd485-a9ea-4977-a2d7-9c3a11fa040b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:46.984153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a5cd485-a9ea-4977-a2d7-9c3a11fa040b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:46.990927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5cd485-a9ea-4977-a2d7-9c3a11fa040b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:46.991388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5cd485-a9ea-4977-a2d7-9c3a11fa040b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:46.992140 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5cd485-a9ea-4977-a2d7-9c3a11fa040b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:46.992564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5cd485-a9ea-4977-a2d7-9c3a11fa040b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:47.025539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a5cd485-a9ea-4977-a2d7-9c3a11fa040b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049792 Jul 04 05:57:47.026090 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 265/520] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 05:57:46 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:48.038456 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-62fc15b0-fda4-441c-b67c-25e1fb5175be tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:48.039443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-62fc15b0-fda4-441c-b67c-25e1fb5175be tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:48.047017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62fc15b0-fda4-441c-b67c-25e1fb5175be tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:48.047512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62fc15b0-fda4-441c-b67c-25e1fb5175be tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:48.048301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62fc15b0-fda4-441c-b67c-25e1fb5175be tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:48.048744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62fc15b0-fda4-441c-b67c-25e1fb5175be tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:48.078043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-62fc15b0-fda4-441c-b67c-25e1fb5175be tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043764 Jul 04 05:57:48.078626 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 256/521] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 05:57:48 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:49.090420 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a21c8207-f750-47f5-b9a6-34ce8a85f741 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:49.091636 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a21c8207-f750-47f5-b9a6-34ce8a85f741 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:49.093741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:49.099317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a21c8207-f750-47f5-b9a6-34ce8a85f741 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:49.099764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a21c8207-f750-47f5-b9a6-34ce8a85f741 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:49.100566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a21c8207-f750-47f5-b9a6-34ce8a85f741 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:49.100992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a21c8207-f750-47f5-b9a6-34ce8a85f741 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:49.132055 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a21c8207-f750-47f5-b9a6-34ce8a85f741 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045744 Jul 04 05:57:49.132580 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 266/522] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 05:57:49 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 05:57:49.207993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0688c6a8-c77b-4132-b463-862b9014da81 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:49.208528 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0688c6a8-c77b-4132-b463-862b9014da81 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:49.215691 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0688c6a8-c77b-4132-b463-862b9014da81 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:49.216233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0688c6a8-c77b-4132-b463-862b9014da81 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:49.217126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0688c6a8-c77b-4132-b463-862b9014da81 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:49.217626 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0688c6a8-c77b-4132-b463-862b9014da81 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:49.243377 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0688c6a8-c77b-4132-b463-862b9014da81 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 05:57:49.329968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0688c6a8-c77b-4132-b463-862b9014da81 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 204 len: 0 microversion: 2.1 time: 0.125552 Jul 04 05:57:49.330858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 257/523] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 05:57:49 2022] DELETE /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 05:57:49.339199 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8f525c3e-054b-4ed1-adff-eeac3c88b8e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:49.339833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8f525c3e-054b-4ed1-adff-eeac3c88b8e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:49.346465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f525c3e-054b-4ed1-adff-eeac3c88b8e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:49.346948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f525c3e-054b-4ed1-adff-eeac3c88b8e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:49.348532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f525c3e-054b-4ed1-adff-eeac3c88b8e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:49.352271 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f525c3e-054b-4ed1-adff-eeac3c88b8e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:49.479272 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8f525c3e-054b-4ed1-adff-eeac3c88b8e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:49.487530 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8f525c3e-054b-4ed1-adff-eeac3c88b8e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1680 microversion: 2.1 time: 0.152447 Jul 04 05:57:49.488166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 267/524] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:49 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:49.781796 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2c273ced-afd5-44a6-b9ad-ab8dc583683d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:49.782385 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2c273ced-afd5-44a6-b9ad-ab8dc583683d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:49.788778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c273ced-afd5-44a6-b9ad-ab8dc583683d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:49.789230 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c273ced-afd5-44a6-b9ad-ab8dc583683d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:49.790017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c273ced-afd5-44a6-b9ad-ab8dc583683d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:49.790424 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c273ced-afd5-44a6-b9ad-ab8dc583683d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:49.815952 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2c273ced-afd5-44a6-b9ad-ab8dc583683d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 05:57:49.899903 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2c273ced-afd5-44a6-b9ad-ab8dc583683d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 204 len: 0 microversion: 2.1 time: 0.122126 Jul 04 05:57:49.900479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 258/525] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 05:57:49 2022] DELETE /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 05:57:49.909147 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a9e44cdc-3d7b-400c-b64e-28e9ed824a19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:49.909759 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a9e44cdc-3d7b-400c-b64e-28e9ed824a19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:49.916018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9e44cdc-3d7b-400c-b64e-28e9ed824a19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:49.916463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9e44cdc-3d7b-400c-b64e-28e9ed824a19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:49.917333 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9e44cdc-3d7b-400c-b64e-28e9ed824a19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:49.917773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9e44cdc-3d7b-400c-b64e-28e9ed824a19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:50.067994 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a9e44cdc-3d7b-400c-b64e-28e9ed824a19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:50.078680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a9e44cdc-3d7b-400c-b64e-28e9ed824a19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1514 microversion: 2.1 time: 0.173485 Jul 04 05:57:50.079350 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 268/526] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:49 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:50.508364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2525df9f-b7ec-483e-9761-01315ce166d2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:50.509085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2525df9f-b7ec-483e-9761-01315ce166d2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:50.515567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2525df9f-b7ec-483e-9761-01315ce166d2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:50.516017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2525df9f-b7ec-483e-9761-01315ce166d2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:50.516785 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2525df9f-b7ec-483e-9761-01315ce166d2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:50.517222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2525df9f-b7ec-483e-9761-01315ce166d2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:50.661876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2525df9f-b7ec-483e-9761-01315ce166d2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:50.670659 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2525df9f-b7ec-483e-9761-01315ce166d2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1680 microversion: 2.1 time: 0.166693 Jul 04 05:57:50.671223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 259/527] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:50 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:51.098284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dd656db7-f111-4570-9276-0d2f77369e53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:51.098901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dd656db7-f111-4570-9276-0d2f77369e53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:51.106162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd656db7-f111-4570-9276-0d2f77369e53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:51.106612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd656db7-f111-4570-9276-0d2f77369e53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:51.107433 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd656db7-f111-4570-9276-0d2f77369e53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:51.107863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd656db7-f111-4570-9276-0d2f77369e53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:51.247140 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd656db7-f111-4570-9276-0d2f77369e53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:51.256366 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dd656db7-f111-4570-9276-0d2f77369e53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1514 microversion: 2.1 time: 0.162184 Jul 04 05:57:51.256965 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 269/528] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:51 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:51.688131 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d89a132d-71f3-4831-b6a0-054bb83bd4e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:51.689437 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d89a132d-71f3-4831-b6a0-054bb83bd4e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:51.696913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d89a132d-71f3-4831-b6a0-054bb83bd4e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:51.697348 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d89a132d-71f3-4831-b6a0-054bb83bd4e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:51.698214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d89a132d-71f3-4831-b6a0-054bb83bd4e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:51.698616 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d89a132d-71f3-4831-b6a0-054bb83bd4e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:51.833228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d89a132d-71f3-4831-b6a0-054bb83bd4e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:51.840777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d89a132d-71f3-4831-b6a0-054bb83bd4e2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1680 microversion: 2.1 time: 0.156512 Jul 04 05:57:51.841341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 260/529] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:51 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:52.273905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d6842a0b-24b9-4158-853c-9a209e3f8389 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:52.274516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d6842a0b-24b9-4158-853c-9a209e3f8389 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:52.281446 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6842a0b-24b9-4158-853c-9a209e3f8389 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:52.281942 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6842a0b-24b9-4158-853c-9a209e3f8389 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:52.282726 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6842a0b-24b9-4158-853c-9a209e3f8389 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:52.283218 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6842a0b-24b9-4158-853c-9a209e3f8389 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:52.413723 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d6842a0b-24b9-4158-853c-9a209e3f8389 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:52.417292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:52.422277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d6842a0b-24b9-4158-853c-9a209e3f8389 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1514 microversion: 2.1 time: 0.152288 Jul 04 05:57:52.422856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 270/530] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:52 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:52.858239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3e615845-7d83-4f10-afc1-fa99cda8e1f8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:52.858987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3e615845-7d83-4f10-afc1-fa99cda8e1f8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:52.865768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e615845-7d83-4f10-afc1-fa99cda8e1f8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:52.866212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e615845-7d83-4f10-afc1-fa99cda8e1f8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:52.866993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e615845-7d83-4f10-afc1-fa99cda8e1f8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:52.867445 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e615845-7d83-4f10-afc1-fa99cda8e1f8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:53.000548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3e615845-7d83-4f10-afc1-fa99cda8e1f8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:53.004253 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:53.010086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3e615845-7d83-4f10-afc1-fa99cda8e1f8 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1680 microversion: 2.1 time: 0.155803 Jul 04 05:57:53.010879 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 261/531] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:52 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:53.440377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fee8df13-e4c3-46a7-b641-37136908252a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:53.441251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fee8df13-e4c3-46a7-b641-37136908252a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:53.449940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fee8df13-e4c3-46a7-b641-37136908252a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:53.450381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fee8df13-e4c3-46a7-b641-37136908252a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:53.451485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fee8df13-e4c3-46a7-b641-37136908252a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:53.451930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fee8df13-e4c3-46a7-b641-37136908252a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:53.775609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fee8df13-e4c3-46a7-b641-37136908252a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:53.789498 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fee8df13-e4c3-46a7-b641-37136908252a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 200 len: 1514 microversion: 2.1 time: 0.353264 Jul 04 05:57:53.791374 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-81fd8a27-8bdd-4d1f-94e9-961829471aa5 req-e9be43b3-59f5-4fab-9886-dc546112f950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f46f48-e103-480b-89aa-f3a9b0a01bc8", "name": "network-vif-deleted", "tag": "49e7c0bb-a6c5-4be3-a26b-06d3b6936c19"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:53.800947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-81fd8a27-8bdd-4d1f-94e9-961829471aa5 req-e9be43b3-59f5-4fab-9886-dc546112f950 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:53.801420 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 271/532] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:53 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 1514 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:53.801702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-81fd8a27-8bdd-4d1f-94e9-961829471aa5 req-e9be43b3-59f5-4fab-9886-dc546112f950 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:53.815905 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-81fd8a27-8bdd-4d1f-94e9-961829471aa5 req-e9be43b3-59f5-4fab-9886-dc546112f950 service nova] Creating event network-vif-deleted:49e7c0bb-a6c5-4be3-a26b-06d3b6936c19 for instance 58f46f48-e103-480b-89aa-f3a9b0a01bc8 on hv-cinder-79733 Jul 04 05:57:53.821521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-81fd8a27-8bdd-4d1f-94e9-961829471aa5 req-e9be43b3-59f5-4fab-9886-dc546112f950 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033784 Jul 04 05:57:53.822448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 262/533] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:57:54.028711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2b7280cc-3a5e-43b9-aa4d-658aff57ccb7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:54.029330 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2b7280cc-3a5e-43b9-aa4d-658aff57ccb7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:54.037119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b7280cc-3a5e-43b9-aa4d-658aff57ccb7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:54.037603 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b7280cc-3a5e-43b9-aa4d-658aff57ccb7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:54.038382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b7280cc-3a5e-43b9-aa4d-658aff57ccb7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:54.038801 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b7280cc-3a5e-43b9-aa4d-658aff57ccb7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:54.121153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2b7280cc-3a5e-43b9-aa4d-658aff57ccb7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:54.128960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2b7280cc-3a5e-43b9-aa4d-658aff57ccb7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1612 microversion: 2.1 time: 0.104579 Jul 04 05:57:54.129537 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 272/534] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:54 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1612 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:54.798454 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-73c47b86-7950-4fd9-bba3-7c80a7337456 req-c4b49a49-1fcb-4fae-a05c-bcb01a3608cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a604de-7fc4-4f6c-9fce-acd174439f47", "name": "network-vif-deleted", "tag": "e8ce7b84-57c9-44e0-97c0-aac43b68abec"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:54.807805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-17105505-039d-4927-ab08-7aff9e0e819f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:54.808424 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-17105505-039d-4927-ab08-7aff9e0e819f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 58f46f48-e103-480b-89aa-f3a9b0a01bc8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:54.820995 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17105505-039d-4927-ab08-7aff9e0e819f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:54.827193 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-73c47b86-7950-4fd9-bba3-7c80a7337456 req-c4b49a49-1fcb-4fae-a05c-bcb01a3608cd service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:54.827695 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-73c47b86-7950-4fd9-bba3-7c80a7337456 req-c4b49a49-1fcb-4fae-a05c-bcb01a3608cd service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:54.828778 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17105505-039d-4927-ab08-7aff9e0e819f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:54.829630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17105505-039d-4927-ab08-7aff9e0e819f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:54.830258 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17105505-039d-4927-ab08-7aff9e0e819f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:54.849757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-73c47b86-7950-4fd9-bba3-7c80a7337456 req-c4b49a49-1fcb-4fae-a05c-bcb01a3608cd service nova] Creating event network-vif-deleted:e8ce7b84-57c9-44e0-97c0-aac43b68abec for instance 91a604de-7fc4-4f6c-9fce-acd174439f47 on hv-cinder-79733 Jul 04 05:57:54.855185 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-73c47b86-7950-4fd9-bba3-7c80a7337456 req-c4b49a49-1fcb-4fae-a05c-bcb01a3608cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071757 Jul 04 05:57:54.856318 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 263/535] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:54.870452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-17105505-039d-4927-ab08-7aff9e0e819f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] HTTP exception thrown: Instance 58f46f48-e103-480b-89aa-f3a9b0a01bc8 could not be found. Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-17105505-039d-4927-ab08-7aff9e0e819f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Request method failure captured: Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 HTTP/1.1 Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoEGdHg5paXj5VCfxV3z9Y8_qncKVkmYRizmDA44NKV8BtIzJ6K6VW05grJ9cSaQhe1JjWI1m6wcSbdFYmxEDjYZf2HA5LWVABpkezNRgtG61--Ei9MyXCOZhsC1vs8GKm7UJR9IR1b0VycoMKVEisGcYhYhHbELkTSiG0s95psRPfo Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: b3ee0596be3b4648bd859293e02b1944 Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotTestJSON-428638042 Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:57:54.872663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3ee0596be3b4648bd859293e02b1944"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3ee0596be3b4648bd859293e02b1944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3ee0596be3b4648bd859293e02b1944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3ee0596be3b4648bd859293e02b1944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotTestJSON-428638042 Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: b3ee0596be3b4648bd859293e02b1944 Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-428638042 Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotTestJSON-428638042-project Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: e78b454f9d0b4e99ae0425cd596f02c0 Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotTestJSON-428638042-project Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 58f46f48-e103-480b-89aa-f3a9b0a01bc8 could not be found. Jul 04 05:57:54.874617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '58f46f48-e103-480b-89aa-f3a9b0a01bc8'} Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f46f48-e103-480b-89aa-f3a9b0a01bc8 could not be found. Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:57:54.875693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f46f48-e103-480b-89aa-f3a9b0a01bc8 could not be found. Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f46f48-e103-480b-89aa-f3a9b0a01bc8 could not be found. Jul 04 05:57:54.877064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:54.879272 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-17105505-039d-4927-ab08-7aff9e0e819f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Returning 404 to user: Instance 58f46f48-e103-480b-89aa-f3a9b0a01bc8 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:57:54.880371 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-17105505-039d-4927-ab08-7aff9e0e819f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8" status: 404 len: 111 microversion: 2.1 time: 0.076530 Jul 04 05:57:54.881211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 273/536] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:54 2022] GET /compute/v2.1/servers/58f46f48-e103-480b-89aa-f3a9b0a01bc8 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:57:55.147804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8c95785a-ac95-4fcd-bc8c-7ce8d02d1f16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:55.148607 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8c95785a-ac95-4fcd-bc8c-7ce8d02d1f16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:55.155931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c95785a-ac95-4fcd-bc8c-7ce8d02d1f16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:55.156339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c95785a-ac95-4fcd-bc8c-7ce8d02d1f16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:55.157388 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c95785a-ac95-4fcd-bc8c-7ce8d02d1f16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:55.157877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c95785a-ac95-4fcd-bc8c-7ce8d02d1f16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:55.191130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c95785a-ac95-4fcd-bc8c-7ce8d02d1f16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:55.192024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c95785a-ac95-4fcd-bc8c-7ce8d02d1f16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:55.192679 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-8c95785a-ac95-4fcd-bc8c-7ce8d02d1f16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lazy-loading 'fault' on Instance uuid 91a604de-7fc4-4f6c-9fce-acd174439f47 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:57:55.244593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8c95785a-ac95-4fcd-bc8c-7ce8d02d1f16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:57:55.255346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8c95785a-ac95-4fcd-bc8c-7ce8d02d1f16 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 200 len: 1330 microversion: 2.1 time: 0.112647 Jul 04 05:57:55.256280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 264/537] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:55 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:57:56.273579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-94f16e74-5a46-4a71-81a3-0df9a51b61c5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:56.274992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-94f16e74-5a46-4a71-81a3-0df9a51b61c5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:57:56.286593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f16e74-5a46-4a71-81a3-0df9a51b61c5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:56.287319 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f16e74-5a46-4a71-81a3-0df9a51b61c5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:56.302415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f16e74-5a46-4a71-81a3-0df9a51b61c5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:56.303090 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f16e74-5a46-4a71-81a3-0df9a51b61c5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:56.329996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-94f16e74-5a46-4a71-81a3-0df9a51b61c5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-94f16e74-5a46-4a71-81a3-0df9a51b61c5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 HTTP/1.1 Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:57:56.337694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 05:57:56.339158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '91a604de-7fc4-4f6c-9fce-acd174439f47'} Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:57:56.339940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 05:57:56.341080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:57:56.343619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-94f16e74-5a46-4a71-81a3-0df9a51b61c5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:57:56.345075 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-94f16e74-5a46-4a71-81a3-0df9a51b61c5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 404 len: 111 microversion: 2.1 time: 0.076709 Jul 04 05:57:56.346209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 274/538] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:57:56 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 05:57:56.357468 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ccda62b2-d077-49bb-9556-2dade9fc95cd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '.version_select at 0x7f2047712f70>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:57:56.380432 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ccda62b2-d077-49bb-9556-2dade9fc95cd tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842269947" status: 202 len: 0 microversion: 2.1 time: 0.029474 Jul 04 05:57:56.381193 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 265/539] 10.222.0.42 () {58 vars in 1217 bytes} [Mon Jul 4 05:57:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842269947 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:57:57.509705 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15133669-2e27-4d3b-a385-5848087db1f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Action: 'create', calling method: .version_select at 0x7f2047703ee0>, body: {"keypair": {"name": "tempest-keypair-1903286229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErey4dDD0BExuYYIyxrF2FePSa4yZCmhWqa4d/TQ3CUwF8iDyPDsXBrLUpOOYyexJrrtRKQbBBRBslGjAbA+nqOuHExpMhbYtUUpe7zSddZ8eTjUyBHfQCBoVX06orpzw=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:57.544193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-15133669-2e27-4d3b-a385-5848087db1f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for project 4e16375231df4b768b8355e320e91731. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:57:57.551684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-15133669-2e27-4d3b-a385-5848087db1f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for user e367c76dfa7f4d2791e60ce148f352c3 and project 4e16375231df4b768b8355e320e91731. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:57:57.586141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-15133669-2e27-4d3b-a385-5848087db1f5 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080236 Jul 04 05:57:57.587303 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 275/540] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jul 4 05:57:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:57:59.290724 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1489686608", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cff6865-4d61-43fd-b392-bb40cec9d37d"}], "security_groups": [{"name": "tempest-securitygroup--576314878"}], "key_name": "tempest-keypair-1903286229", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:57:59.303780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:59.421439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] validate_networks() for [('9cff6865-4d61-43fd-b392-bb40cec9d37d', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:57:59.881936 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:57:59.882394 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:57:59.882958 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:57:59.883378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:57:59.883993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:57:59.895893 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:59.896549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:59.897355 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:57:59.897949 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:57:59.925882 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for project 4e16375231df4b768b8355e320e91731. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:57:59.930797 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for user e367c76dfa7f4d2791e60ce148f352c3 and project 4e16375231df4b768b8355e320e91731. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:57:59.945168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:57:59.947615 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:58:00.013582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eafb8aca-0784-40f2-a31b-ee886ce52503 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.727307 Jul 04 05:58:00.014422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 266/541] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:57:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:58:00.026256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4dd5c8ba-6f8c-450a-aa81-af6d64c74dce tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:00.027691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4dd5c8ba-6f8c-450a-aa81-af6d64c74dce tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:00.168989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4dd5c8ba-6f8c-450a-aa81-af6d64c74dce tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:00.178199 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4dd5c8ba-6f8c-450a-aa81-af6d64c74dce tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1242 microversion: 2.1 time: 0.156391 Jul 04 05:58:00.185572 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 276/542] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:00 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:01.212534 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-70ac6e51-2b64-4036-90b7-925664d128ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:01.214240 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-70ac6e51-2b64-4036-90b7-925664d128ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:01.233356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70ac6e51-2b64-4036-90b7-925664d128ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:01.233880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70ac6e51-2b64-4036-90b7-925664d128ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:01.235230 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70ac6e51-2b64-4036-90b7-925664d128ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:01.235727 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70ac6e51-2b64-4036-90b7-925664d128ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:01.317024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-70ac6e51-2b64-4036-90b7-925664d128ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:01.324958 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-70ac6e51-2b64-4036-90b7-925664d128ed tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1246 microversion: 2.1 time: 0.126591 Jul 04 05:58:01.326169 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 267/543] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:01 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1246 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:02.342737 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f1090cb8-73b8-46f4-b8e8-5447c0216c15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:02.344068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f1090cb8-73b8-46f4-b8e8-5447c0216c15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:02.351556 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1090cb8-73b8-46f4-b8e8-5447c0216c15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:02.352018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1090cb8-73b8-46f4-b8e8-5447c0216c15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:02.352769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1090cb8-73b8-46f4-b8e8-5447c0216c15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:02.354653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1090cb8-73b8-46f4-b8e8-5447c0216c15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:02.443448 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f1090cb8-73b8-46f4-b8e8-5447c0216c15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:02.452385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f1090cb8-73b8-46f4-b8e8-5447c0216c15 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1246 microversion: 2.1 time: 0.113698 Jul 04 05:58:02.453710 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 277/544] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:02 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:03.117137 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-43023609", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "networks": [{"uuid": "bce2b5d0-0a48-4248-902a-974ee1810a73"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:03.173774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] validate_networks() for [('bce2b5d0-0a48-4248-902a-974ee1810a73', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:58:03.472444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b27723b2-1153-44d3-a2e8-81e5890d1c7b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:03.473706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b27723b2-1153-44d3-a2e8-81e5890d1c7b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:03.485024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b27723b2-1153-44d3-a2e8-81e5890d1c7b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:03.485774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b27723b2-1153-44d3-a2e8-81e5890d1c7b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:03.486736 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b27723b2-1153-44d3-a2e8-81e5890d1c7b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:03.489792 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b27723b2-1153-44d3-a2e8-81e5890d1c7b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:03.647344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b27723b2-1153-44d3-a2e8-81e5890d1c7b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:03.650125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:58:03.650695 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:58:03.651517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:58:03.651897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:58:03.652477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:58:03.664286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:03.665770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:03.666601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b27723b2-1153-44d3-a2e8-81e5890d1c7b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1302 microversion: 2.1 time: 0.198788 Jul 04 05:58:03.671168 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 278/545] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:03 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1302 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:03.676177 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:03.676968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:03.699040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Getting quotas for project b3ee0596be3b4648bd859293e02b1944. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:58:03.703879 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Getting quotas for user e78b454f9d0b4e99ae0425cd596f02c0 and project b3ee0596be3b4648bd859293e02b1944. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:58:03.720050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:58:03.722356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:58:03.797449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6315b61c-efa4-4327-9fcc-5ef1c3da3f4b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684072 Jul 04 05:58:03.803841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 268/546] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:58:03.814513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-869a616b-84d3-4a3d-adea-9388b1b704d5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:03.815736 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-869a616b-84d3-4a3d-adea-9388b1b704d5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:03.923146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-869a616b-84d3-4a3d-adea-9388b1b704d5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:03.940611 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-869a616b-84d3-4a3d-adea-9388b1b704d5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1217 microversion: 2.1 time: 0.129933 Jul 04 05:58:03.941601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 279/547] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:03 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:04.676548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6c00df74-3dea-4d29-bbfe-badff10ec0a1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Action: 'create', calling method: .version_select at 0x7f204765eb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-426821201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDlyS4T0iRhTk4+JJ+7rlNRY+LlncefvEFqaM73VSDMpqYFbBIvf/a2ps0hKww7cyrHNmzFFcXxXHQe4NwU8t+T3RGDdxwHaVAUtd/xIbbx0d1E48NJchBKqRRLhKttUQ=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:04.684474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-14b64495-60d9-49a2-bafb-3b2fd4e3f72c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:04.685193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-14b64495-60d9-49a2-bafb-3b2fd4e3f72c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:04.695060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14b64495-60d9-49a2-bafb-3b2fd4e3f72c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:04.695535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14b64495-60d9-49a2-bafb-3b2fd4e3f72c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:04.696301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14b64495-60d9-49a2-bafb-3b2fd4e3f72c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:04.696756 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14b64495-60d9-49a2-bafb-3b2fd4e3f72c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:04.701202 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6c00df74-3dea-4d29-bbfe-badff10ec0a1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Getting quotas for project 8d701a66ecbb480fa08e97f304acf57b. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:58:04.705679 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6c00df74-3dea-4d29-bbfe-badff10ec0a1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Getting quotas for user 6ac9756c145040e58f9d914ba5bcdfaa and project 8d701a66ecbb480fa08e97f304acf57b. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:58:04.734515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6c00df74-3dea-4d29-bbfe-badff10ec0a1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.301443 Jul 04 05:58:04.735499 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 269/548] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jul 4 05:58:04 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:58:04.782257 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-14b64495-60d9-49a2-bafb-3b2fd4e3f72c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:04.792245 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-14b64495-60d9-49a2-bafb-3b2fd4e3f72c tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1300 microversion: 2.1 time: 0.111520 Jul 04 05:58:04.793319 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 280/549] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:04 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:04.958649 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ebbb53cf-dd66-4d3e-812a-7c8e195e2ddc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:04.959310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ebbb53cf-dd66-4d3e-812a-7c8e195e2ddc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:04.968576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebbb53cf-dd66-4d3e-812a-7c8e195e2ddc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:04.969029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebbb53cf-dd66-4d3e-812a-7c8e195e2ddc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:04.970722 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebbb53cf-dd66-4d3e-812a-7c8e195e2ddc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:04.971196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebbb53cf-dd66-4d3e-812a-7c8e195e2ddc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:05.088266 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ebbb53cf-dd66-4d3e-812a-7c8e195e2ddc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:05.097425 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ebbb53cf-dd66-4d3e-812a-7c8e195e2ddc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1269 microversion: 2.1 time: 0.143304 Jul 04 05:58:05.098749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 270/550] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:04 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1269 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:05.810828 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c283435e-d8d0-4036-832e-5f3dbc080b46 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:05.811889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c283435e-d8d0-4036-832e-5f3dbc080b46 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:05.824772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c283435e-d8d0-4036-832e-5f3dbc080b46 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:05.831734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c283435e-d8d0-4036-832e-5f3dbc080b46 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:05.832972 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c283435e-d8d0-4036-832e-5f3dbc080b46 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:05.833573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c283435e-d8d0-4036-832e-5f3dbc080b46 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:06.115854 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73e20844-c667-4793-b935-2b77b0cf9305 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:06.117932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73e20844-c667-4793-b935-2b77b0cf9305 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:06.131866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e20844-c667-4793-b935-2b77b0cf9305 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:06.138094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e20844-c667-4793-b935-2b77b0cf9305 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:06.139315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e20844-c667-4793-b935-2b77b0cf9305 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:06.142876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e20844-c667-4793-b935-2b77b0cf9305 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:06.162236 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c283435e-d8d0-4036-832e-5f3dbc080b46 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:06.173141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c283435e-d8d0-4036-832e-5f3dbc080b46 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1367 microversion: 2.1 time: 0.366585 Jul 04 05:58:06.173728 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 281/551] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:05 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:06.191019 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-96ea6e5d-4a12-40d7-ac65-1870418571e4 req-0ecda252-db42-4775-971b-faf6ab498a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad9b47c-9ec3-4208-baf7-6743e129f162", "tag": "7c47e3eb-c2ec-4ceb-8f41-d4bd404babd5"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:06.213850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-96ea6e5d-4a12-40d7-ac65-1870418571e4 req-0ecda252-db42-4775-971b-faf6ab498a3a service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:06.214295 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-96ea6e5d-4a12-40d7-ac65-1870418571e4 req-0ecda252-db42-4775-971b-faf6ab498a3a service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:06.234215 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-96ea6e5d-4a12-40d7-ac65-1870418571e4 req-0ecda252-db42-4775-971b-faf6ab498a3a service nova] Creating event network-changed:7c47e3eb-c2ec-4ceb-8f41-d4bd404babd5 for instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 on hv-cinder-79733 Jul 04 05:58:06.246342 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-96ea6e5d-4a12-40d7-ac65-1870418571e4 req-0ecda252-db42-4775-971b-faf6ab498a3a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067053 Jul 04 05:58:06.250069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 282/552] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:58:06.349716 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73e20844-c667-4793-b935-2b77b0cf9305 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:06.375042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73e20844-c667-4793-b935-2b77b0cf9305 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1275 microversion: 2.1 time: 0.263075 Jul 04 05:58:06.376323 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 271/553] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:06 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:07.191448 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c61594e7-1f5d-4bcd-bc53-534d6bac596e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:07.192267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c61594e7-1f5d-4bcd-bc53-534d6bac596e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:07.199473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c61594e7-1f5d-4bcd-bc53-534d6bac596e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:07.199907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c61594e7-1f5d-4bcd-bc53-534d6bac596e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:07.200793 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c61594e7-1f5d-4bcd-bc53-534d6bac596e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:07.201676 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c61594e7-1f5d-4bcd-bc53-534d6bac596e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:07.351523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c61594e7-1f5d-4bcd-bc53-534d6bac596e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:07.359528 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c61594e7-1f5d-4bcd-bc53-534d6bac596e tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1367 microversion: 2.1 time: 0.173251 Jul 04 05:58:07.360654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 283/554] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:07 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:07.394069 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0d8c878c-78c8-4fa9-983d-81bdd1b48de1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:07.394816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0d8c878c-78c8-4fa9-983d-81bdd1b48de1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:07.403276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d8c878c-78c8-4fa9-983d-81bdd1b48de1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:07.403822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d8c878c-78c8-4fa9-983d-81bdd1b48de1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:07.404674 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d8c878c-78c8-4fa9-983d-81bdd1b48de1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:07.405236 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d8c878c-78c8-4fa9-983d-81bdd1b48de1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:07.556544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-cedfea97-a496-43c9-a7fa-ccfe0d55dfd6 req-ceed7e40-ad0f-4455-be37-37e6235478eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9120ac5f-6d50-4583-adae-9bc3766e686f", "tag": "3a2af85f-c3ee-4fa8-9b23-ba37662e58b6"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:07.565485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-cedfea97-a496-43c9-a7fa-ccfe0d55dfd6 req-ceed7e40-ad0f-4455-be37-37e6235478eb service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:07.565932 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-cedfea97-a496-43c9-a7fa-ccfe0d55dfd6 req-ceed7e40-ad0f-4455-be37-37e6235478eb service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:07.577744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-cedfea97-a496-43c9-a7fa-ccfe0d55dfd6 req-ceed7e40-ad0f-4455-be37-37e6235478eb service nova] Creating event network-changed:3a2af85f-c3ee-4fa8-9b23-ba37662e58b6 for instance 9120ac5f-6d50-4583-adae-9bc3766e686f on hv-cinder-79733 Jul 04 05:58:07.584395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-cedfea97-a496-43c9-a7fa-ccfe0d55dfd6 req-ceed7e40-ad0f-4455-be37-37e6235478eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031313 Jul 04 05:58:07.585347 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 284/555] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:58:07.629219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0d8c878c-78c8-4fa9-983d-81bdd1b48de1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:07.637086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0d8c878c-78c8-4fa9-983d-81bdd1b48de1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1317 microversion: 2.1 time: 0.248465 Jul 04 05:58:07.637972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 272/556] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:07 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:08.377991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0a1955a-a2b5-4515-ae70-b8ab9a251b5a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:08.378763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c0a1955a-a2b5-4515-ae70-b8ab9a251b5a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:08.390895 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0a1955a-a2b5-4515-ae70-b8ab9a251b5a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:08.391774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0a1955a-a2b5-4515-ae70-b8ab9a251b5a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:08.392819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0a1955a-a2b5-4515-ae70-b8ab9a251b5a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:08.393964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0a1955a-a2b5-4515-ae70-b8ab9a251b5a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:08.633252 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c0a1955a-a2b5-4515-ae70-b8ab9a251b5a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:08.643091 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c0a1955a-a2b5-4515-ae70-b8ab9a251b5a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1367 microversion: 2.1 time: 0.269830 Jul 04 05:58:08.648671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 285/557] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:08 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:08.657886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5fa8aa35-013e-426f-8a80-05c03b726b81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:08.658501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5fa8aa35-013e-426f-8a80-05c03b726b81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:08.674827 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fa8aa35-013e-426f-8a80-05c03b726b81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:08.677443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fa8aa35-013e-426f-8a80-05c03b726b81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:08.678341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fa8aa35-013e-426f-8a80-05c03b726b81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:08.678788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fa8aa35-013e-426f-8a80-05c03b726b81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:08.821260 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5fa8aa35-013e-426f-8a80-05c03b726b81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:08.828879 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5fa8aa35-013e-426f-8a80-05c03b726b81 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1317 microversion: 2.1 time: 0.175881 Jul 04 05:58:08.829727 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 273/558] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:08 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:09.664265 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d495f286-90b7-42ca-8813-f5867a7a5460 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:09.665504 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d495f286-90b7-42ca-8813-f5867a7a5460 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:09.673334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d495f286-90b7-42ca-8813-f5867a7a5460 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:09.674169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d495f286-90b7-42ca-8813-f5867a7a5460 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:09.674952 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d495f286-90b7-42ca-8813-f5867a7a5460 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:09.675413 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d495f286-90b7-42ca-8813-f5867a7a5460 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:09.847497 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1722bb1f-1a4b-498e-9bd7-16f53ae1db66 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:09.850909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1722bb1f-1a4b-498e-9bd7-16f53ae1db66 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:09.859726 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1722bb1f-1a4b-498e-9bd7-16f53ae1db66 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:09.860489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1722bb1f-1a4b-498e-9bd7-16f53ae1db66 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:09.861429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1722bb1f-1a4b-498e-9bd7-16f53ae1db66 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:09.862030 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1722bb1f-1a4b-498e-9bd7-16f53ae1db66 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:09.880473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d495f286-90b7-42ca-8813-f5867a7a5460 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:09.891674 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d495f286-90b7-42ca-8813-f5867a7a5460 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1367 microversion: 2.1 time: 0.231032 Jul 04 05:58:09.892286 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 286/559] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:09 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:10.073203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1722bb1f-1a4b-498e-9bd7-16f53ae1db66 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:10.090407 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1722bb1f-1a4b-498e-9bd7-16f53ae1db66 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1317 microversion: 2.1 time: 0.248209 Jul 04 05:58:10.091639 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 274/560] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:09 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:10.694291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dccbde39-da29-4191-9eda-ede494f61f33 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:10.694863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dccbde39-da29-4191-9eda-ede494f61f33 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:10.701643 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dccbde39-da29-4191-9eda-ede494f61f33 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:10.702093 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dccbde39-da29-4191-9eda-ede494f61f33 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:10.702857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dccbde39-da29-4191-9eda-ede494f61f33 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:10.703279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dccbde39-da29-4191-9eda-ede494f61f33 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:10.791404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-dccbde39-da29-4191-9eda-ede494f61f33 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lazy-loading 'services' on Instance uuid 9979d81a-1d93-423a-b99e-74434186140a {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:58:10.869334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dccbde39-da29-4191-9eda-ede494f61f33 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/os-volume_attachments/a3a3574d-2743-4404-ac39-84dff0dc7fa5" status: 202 len: 0 microversion: 2.1 time: 0.178991 Jul 04 05:58:10.869923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 287/561] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jul 4 05:58:10 2022] DELETE /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/os-volume_attachments/a3a3574d-2743-4404-ac39-84dff0dc7fa5 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:58:10.911128 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-337c27e9-fcca-4792-862d-f4e89be763dc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:10.911776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-337c27e9-fcca-4792-862d-f4e89be763dc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:10.919459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-337c27e9-fcca-4792-862d-f4e89be763dc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:10.920483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-337c27e9-fcca-4792-862d-f4e89be763dc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:10.921761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-337c27e9-fcca-4792-862d-f4e89be763dc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:10.922329 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-337c27e9-fcca-4792-862d-f4e89be763dc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:11.065119 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-337c27e9-fcca-4792-862d-f4e89be763dc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:11.072588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-337c27e9-fcca-4792-862d-f4e89be763dc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1367 microversion: 2.1 time: 0.167493 Jul 04 05:58:11.073153 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 275/562] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:10 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:11.111896 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-297d6b1b-6502-4e62-96ff-3f468f9e7773 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:11.112630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-297d6b1b-6502-4e62-96ff-3f468f9e7773 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:11.119190 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-297d6b1b-6502-4e62-96ff-3f468f9e7773 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:11.119675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-297d6b1b-6502-4e62-96ff-3f468f9e7773 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:11.120430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-297d6b1b-6502-4e62-96ff-3f468f9e7773 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:11.120862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-297d6b1b-6502-4e62-96ff-3f468f9e7773 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:11.267234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-297d6b1b-6502-4e62-96ff-3f468f9e7773 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:11.276851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-297d6b1b-6502-4e62-96ff-3f468f9e7773 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1317 microversion: 2.1 time: 0.170020 Jul 04 05:58:11.277446 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 288/563] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:11 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:11.998630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1fa18165-e455-4473-afb0-d6804bda0424 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:12.005533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fa18165-e455-4473-afb0-d6804bda0424 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:12.006053 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fa18165-e455-4473-afb0-d6804bda0424 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:12.028876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1fa18165-e455-4473-afb0-d6804bda0424 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Going to try to stop instance {{(pid=117606) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 05:58:12.077775 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1fa18165-e455-4473-afb0-d6804bda0424 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "POST /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/action" status: 202 len: 0 microversion: 2.1 time: 0.083065 Jul 04 05:58:12.078627 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 276/564] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 05:58:11 2022] POST /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 05:58:12.087465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-31cbf52e-7c76-48da-b30d-cda5b2befa84 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:12.089154 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-31cbf52e-7c76-48da-b30d-cda5b2befa84 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:12.099096 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93d18e9d-cbd7-406c-a9bb-4f06c8ade385 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:12.099696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31cbf52e-7c76-48da-b30d-cda5b2befa84 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:12.100461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-93d18e9d-cbd7-406c-a9bb-4f06c8ade385 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:12.100601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31cbf52e-7c76-48da-b30d-cda5b2befa84 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:12.101783 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31cbf52e-7c76-48da-b30d-cda5b2befa84 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:12.102255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31cbf52e-7c76-48da-b30d-cda5b2befa84 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:12.107804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93d18e9d-cbd7-406c-a9bb-4f06c8ade385 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:12.108273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93d18e9d-cbd7-406c-a9bb-4f06c8ade385 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:12.109513 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93d18e9d-cbd7-406c-a9bb-4f06c8ade385 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:12.110006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93d18e9d-cbd7-406c-a9bb-4f06c8ade385 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:12.264588 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-31cbf52e-7c76-48da-b30d-cda5b2befa84 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:12.270537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-93d18e9d-cbd7-406c-a9bb-4f06c8ade385 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:12.272872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-31cbf52e-7c76-48da-b30d-cda5b2befa84 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.189529 Jul 04 05:58:12.273441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 289/565] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:12 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:12.278366 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-7e24206f-f46f-4b49-8fcf-23e635b940ef req-8fb40f41-02a9-4a61-a6d1-2608eb7886c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad9b47c-9ec3-4208-baf7-6743e129f162", "name": "network-vif-plugged", "status": "completed", "tag": "7c47e3eb-c2ec-4ceb-8f41-d4bd404babd5"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:12.284267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-93d18e9d-cbd7-406c-a9bb-4f06c8ade385 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1367 microversion: 2.1 time: 0.197099 Jul 04 05:58:12.286723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 277/566] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:12 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:12.288664 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-7e24206f-f46f-4b49-8fcf-23e635b940ef req-8fb40f41-02a9-4a61-a6d1-2608eb7886c6 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:12.288664 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-7e24206f-f46f-4b49-8fcf-23e635b940ef req-8fb40f41-02a9-4a61-a6d1-2608eb7886c6 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:12.294568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-da448c03-c191-4b77-a932-a8ab37a9a65e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:12.295452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-da448c03-c191-4b77-a932-a8ab37a9a65e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:12.301804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da448c03-c191-4b77-a932-a8ab37a9a65e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:12.302532 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da448c03-c191-4b77-a932-a8ab37a9a65e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:12.303436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da448c03-c191-4b77-a932-a8ab37a9a65e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:12.303975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da448c03-c191-4b77-a932-a8ab37a9a65e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:12.304275 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-7e24206f-f46f-4b49-8fcf-23e635b940ef req-8fb40f41-02a9-4a61-a6d1-2608eb7886c6 service nova] Creating event network-vif-plugged:7c47e3eb-c2ec-4ceb-8f41-d4bd404babd5 for instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 on hv-cinder-79733 Jul 04 05:58:12.312673 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-7e24206f-f46f-4b49-8fcf-23e635b940ef req-8fb40f41-02a9-4a61-a6d1-2608eb7886c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037922 Jul 04 05:58:12.313814 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 290/567] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:58:12.448949 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-da448c03-c191-4b77-a932-a8ab37a9a65e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:12.457465 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-da448c03-c191-4b77-a932-a8ab37a9a65e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1317 microversion: 2.1 time: 0.167473 Jul 04 05:58:12.458028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 278/568] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:12 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:13.292581 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0768b42e-f1af-442f-aeec-dc7dfdf88f91 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:13.293346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0768b42e-f1af-442f-aeec-dc7dfdf88f91 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:13.300717 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0768b42e-f1af-442f-aeec-dc7dfdf88f91 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:13.301227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0768b42e-f1af-442f-aeec-dc7dfdf88f91 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:13.301689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b47036f7-231a-4a69-a9fb-8eb39ac52dea tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:13.302166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0768b42e-f1af-442f-aeec-dc7dfdf88f91 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:13.302333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b47036f7-231a-4a69-a9fb-8eb39ac52dea tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:13.302522 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0768b42e-f1af-442f-aeec-dc7dfdf88f91 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:13.309334 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b47036f7-231a-4a69-a9fb-8eb39ac52dea tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:13.309822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b47036f7-231a-4a69-a9fb-8eb39ac52dea tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:13.310542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b47036f7-231a-4a69-a9fb-8eb39ac52dea tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:13.310967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b47036f7-231a-4a69-a9fb-8eb39ac52dea tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:13.441257 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0768b42e-f1af-442f-aeec-dc7dfdf88f91 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:13.447523 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b47036f7-231a-4a69-a9fb-8eb39ac52dea tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:13.448824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0768b42e-f1af-442f-aeec-dc7dfdf88f91 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.161373 Jul 04 05:58:13.449403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 291/569] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:13 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:13.455806 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b47036f7-231a-4a69-a9fb-8eb39ac52dea tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1367 microversion: 2.1 time: 0.158409 Jul 04 05:58:13.456454 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 279/570] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:13 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:13.473675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ce48c015-d5e1-45d2-b709-666c5037aee7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:13.474273 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ce48c015-d5e1-45d2-b709-666c5037aee7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:13.483973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce48c015-d5e1-45d2-b709-666c5037aee7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:13.484426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce48c015-d5e1-45d2-b709-666c5037aee7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:13.485315 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce48c015-d5e1-45d2-b709-666c5037aee7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:13.486402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce48c015-d5e1-45d2-b709-666c5037aee7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:13.625776 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ce48c015-d5e1-45d2-b709-666c5037aee7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:13.633742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ce48c015-d5e1-45d2-b709-666c5037aee7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1317 microversion: 2.1 time: 0.163810 Jul 04 05:58:13.634297 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 292/571] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:13 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:14.328833 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-da2adfe7-6349-4f55-a948-6cfe6d03e856 req-b608d5f8-224d-4449-9905-809b931a53bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9120ac5f-6d50-4583-adae-9bc3766e686f", "name": "network-vif-plugged", "status": "completed", "tag": "3a2af85f-c3ee-4fa8-9b23-ba37662e58b6"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:14.332429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:14.338998 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-da2adfe7-6349-4f55-a948-6cfe6d03e856 req-b608d5f8-224d-4449-9905-809b931a53bb service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:14.339472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-da2adfe7-6349-4f55-a948-6cfe6d03e856 req-b608d5f8-224d-4449-9905-809b931a53bb service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:14.350269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-da2adfe7-6349-4f55-a948-6cfe6d03e856 req-b608d5f8-224d-4449-9905-809b931a53bb service nova] Creating event network-vif-plugged:3a2af85f-c3ee-4fa8-9b23-ba37662e58b6 for instance 9120ac5f-6d50-4583-adae-9bc3766e686f on hv-cinder-79733 Jul 04 05:58:14.355136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-da2adfe7-6349-4f55-a948-6cfe6d03e856 req-b608d5f8-224d-4449-9905-809b931a53bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029985 Jul 04 05:58:14.355760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 280/572] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:58:14.469919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f00c0694-1a25-4c97-bda6-68697ca7be4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:14.470909 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f00c0694-1a25-4c97-bda6-68697ca7be4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:14.474652 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=8 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:14.481029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab0362fc-7e1c-4d52-985e-bdfa6b6058aa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:14.482444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab0362fc-7e1c-4d52-985e-bdfa6b6058aa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:14.485437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f00c0694-1a25-4c97-bda6-68697ca7be4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:14.486313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f00c0694-1a25-4c97-bda6-68697ca7be4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:14.488002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f00c0694-1a25-4c97-bda6-68697ca7be4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:14.488517 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f00c0694-1a25-4c97-bda6-68697ca7be4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:14.494115 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:14.500564 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab0362fc-7e1c-4d52-985e-bdfa6b6058aa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:14.501287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab0362fc-7e1c-4d52-985e-bdfa6b6058aa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:14.502215 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab0362fc-7e1c-4d52-985e-bdfa6b6058aa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:14.502723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab0362fc-7e1c-4d52-985e-bdfa6b6058aa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:14.653782 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab0362fc-7e1c-4d52-985e-bdfa6b6058aa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:14.662477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab0362fc-7e1c-4d52-985e-bdfa6b6058aa tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1556 microversion: 2.1 time: 0.191715 Jul 04 05:58:14.663119 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 281/573] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:14 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1556 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:14.668957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6bc33bfc-0d6e-4de1-8088-26830cc21b3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:14.669663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6bc33bfc-0d6e-4de1-8088-26830cc21b3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:14.676328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bc33bfc-0d6e-4de1-8088-26830cc21b3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:14.676770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bc33bfc-0d6e-4de1-8088-26830cc21b3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:14.677537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bc33bfc-0d6e-4de1-8088-26830cc21b3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:14.677966 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bc33bfc-0d6e-4de1-8088-26830cc21b3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:14.679270 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f00c0694-1a25-4c97-bda6-68697ca7be4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:14.687688 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f00c0694-1a25-4c97-bda6-68697ca7be4c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.224539 Jul 04 05:58:14.688268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 293/574] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:14 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:14.693023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2194ce91-d3fa-4a9e-94c5-4fd0f0bf16e3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:14.693546 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2194ce91-d3fa-4a9e-94c5-4fd0f0bf16e3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:14.699454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2194ce91-d3fa-4a9e-94c5-4fd0f0bf16e3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:14.700121 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2194ce91-d3fa-4a9e-94c5-4fd0f0bf16e3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:14.700476 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:14.701268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2194ce91-d3fa-4a9e-94c5-4fd0f0bf16e3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:14.701861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2194ce91-d3fa-4a9e-94c5-4fd0f0bf16e3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:14.715668 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=16 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:14.792004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2194ce91-d3fa-4a9e-94c5-4fd0f0bf16e3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102454 Jul 04 05:58:14.792997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 294/575] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jul 4 05:58:14 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:58:14.818186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6bc33bfc-0d6e-4de1-8088-26830cc21b3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:14.826184 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6bc33bfc-0d6e-4de1-8088-26830cc21b3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1317 microversion: 2.1 time: 0.161854 Jul 04 05:58:14.826751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 282/576] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:14 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:15.705474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a49d1088-dbff-4d21-905a-1fa8383ae272 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:15.705474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a49d1088-dbff-4d21-905a-1fa8383ae272 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:15.712617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a49d1088-dbff-4d21-905a-1fa8383ae272 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:15.713133 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a49d1088-dbff-4d21-905a-1fa8383ae272 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:15.713902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a49d1088-dbff-4d21-905a-1fa8383ae272 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:15.719008 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a49d1088-dbff-4d21-905a-1fa8383ae272 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:15.754228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-c3c407b0-4998-48c0-a7ee-f7ec076c8f5a req-d820feb0-f1ba-4c3c-829d-f9a7f0f6b670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad9b47c-9ec3-4208-baf7-6743e129f162", "tag": "7c47e3eb-c2ec-4ceb-8f41-d4bd404babd5"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:15.764156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-c3c407b0-4998-48c0-a7ee-f7ec076c8f5a req-d820feb0-f1ba-4c3c-829d-f9a7f0f6b670 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:15.764587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-c3c407b0-4998-48c0-a7ee-f7ec076c8f5a req-d820feb0-f1ba-4c3c-829d-f9a7f0f6b670 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:15.776516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-c3c407b0-4998-48c0-a7ee-f7ec076c8f5a req-d820feb0-f1ba-4c3c-829d-f9a7f0f6b670 service nova] Creating event network-changed:7c47e3eb-c2ec-4ceb-8f41-d4bd404babd5 for instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 on hv-cinder-79733 Jul 04 05:58:15.781314 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-c3c407b0-4998-48c0-a7ee-f7ec076c8f5a req-d820feb0-f1ba-4c3c-829d-f9a7f0f6b670 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031193 Jul 04 05:58:15.781921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 283/577] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:58:15.845668 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1fa8b6d4-661b-48a6-891e-eafc534d4f00 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:15.846883 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1fa8b6d4-661b-48a6-891e-eafc534d4f00 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:15.854062 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fa8b6d4-661b-48a6-891e-eafc534d4f00 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:15.854666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fa8b6d4-661b-48a6-891e-eafc534d4f00 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:15.855479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fa8b6d4-661b-48a6-891e-eafc534d4f00 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:15.856117 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fa8b6d4-661b-48a6-891e-eafc534d4f00 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:15.899003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a49d1088-dbff-4d21-905a-1fa8383ae272 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:15.908114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a49d1088-dbff-4d21-905a-1fa8383ae272 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.207588 Jul 04 05:58:15.914800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 295/578] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:15 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:16.003472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1fa8b6d4-661b-48a6-891e-eafc534d4f00 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:16.012558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1fa8b6d4-661b-48a6-891e-eafc534d4f00 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1317 microversion: 2.1 time: 0.172730 Jul 04 05:58:16.013136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 284/579] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:15 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:16.441391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-99f802be-4e8d-4755-8d25-2f4539b2707d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:16.441912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-99f802be-4e8d-4755-8d25-2f4539b2707d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:16.448695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f802be-4e8d-4755-8d25-2f4539b2707d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:16.449145 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f802be-4e8d-4755-8d25-2f4539b2707d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:16.450085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f802be-4e8d-4755-8d25-2f4539b2707d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:16.450578 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f802be-4e8d-4755-8d25-2f4539b2707d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:16.479422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-99f802be-4e8d-4755-8d25-2f4539b2707d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-volume_attachments/0caf326e-261a-48c4-a5c7-c3206bbf3442" status: 200 len: 194 microversion: 2.20 time: 0.042972 Jul 04 05:58:16.480384 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 296/580] 10.222.0.42 () {60 vars in 1453 bytes} [Mon Jul 4 05:58:16 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-volume_attachments/0caf326e-261a-48c4-a5c7-c3206bbf3442 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:58:16.562834 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0cf41a95-a950-422f-abce-3adc143e42d0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:16.563350 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0cf41a95-a950-422f-abce-3adc143e42d0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:16.569469 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf41a95-a950-422f-abce-3adc143e42d0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:16.569916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf41a95-a950-422f-abce-3adc143e42d0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:16.570671 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf41a95-a950-422f-abce-3adc143e42d0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:16.571104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf41a95-a950-422f-abce-3adc143e42d0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:16.706896 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-0cf41a95-a950-422f-abce-3adc143e42d0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lazy-loading 'services' on Instance uuid 178121f0-a865-467e-a46a-069b621b6d17 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:58:16.878988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0cf41a95-a950-422f-abce-3adc143e42d0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "DELETE /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-volume_attachments/0caf326e-261a-48c4-a5c7-c3206bbf3442" status: 202 len: 0 microversion: 2.20 time: 0.319067 Jul 04 05:58:16.880223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 285/581] 10.222.0.42 () {60 vars in 1456 bytes} [Mon Jul 4 05:58:16 2022] DELETE /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-volume_attachments/0caf326e-261a-48c4-a5c7-c3206bbf3442 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 05:58:16.890742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9036d787-46f2-472f-80f8-6ebe23121f5f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:16.893310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9036d787-46f2-472f-80f8-6ebe23121f5f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:16.906763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9036d787-46f2-472f-80f8-6ebe23121f5f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:16.908157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9036d787-46f2-472f-80f8-6ebe23121f5f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:16.909575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9036d787-46f2-472f-80f8-6ebe23121f5f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:16.910220 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9036d787-46f2-472f-80f8-6ebe23121f5f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:16.926953 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c8c7f8be-3d02-4e5c-9844-dbb87c439be8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:16.928151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c8c7f8be-3d02-4e5c-9844-dbb87c439be8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:16.947948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8c7f8be-3d02-4e5c-9844-dbb87c439be8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:16.948531 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8c7f8be-3d02-4e5c-9844-dbb87c439be8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:16.949242 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8c7f8be-3d02-4e5c-9844-dbb87c439be8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:16.949646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8c7f8be-3d02-4e5c-9844-dbb87c439be8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:16.958457 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9036d787-46f2-472f-80f8-6ebe23121f5f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072242 Jul 04 05:58:16.964019 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 297/582] 10.222.0.42 () {60 vars in 1342 bytes} [Mon Jul 4 05:58:16 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 05:58:17.030090 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-188c8d3b-0151-4ce7-adf0-08d0e6d2a8a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:17.030736 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-188c8d3b-0151-4ce7-adf0-08d0e6d2a8a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:17.038281 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-188c8d3b-0151-4ce7-adf0-08d0e6d2a8a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:17.039044 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-188c8d3b-0151-4ce7-adf0-08d0e6d2a8a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:17.039995 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-188c8d3b-0151-4ce7-adf0-08d0e6d2a8a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:17.040578 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-188c8d3b-0151-4ce7-adf0-08d0e6d2a8a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:17.183893 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c8c7f8be-3d02-4e5c-9844-dbb87c439be8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:17.197142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c8c7f8be-3d02-4e5c-9844-dbb87c439be8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.274386 Jul 04 05:58:17.207193 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 286/583] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:16 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:17.510404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-188c8d3b-0151-4ce7-adf0-08d0e6d2a8a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:17.518259 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-188c8d3b-0151-4ce7-adf0-08d0e6d2a8a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1506 microversion: 2.1 time: 0.492858 Jul 04 05:58:17.518994 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 298/584] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:17 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:17.536731 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0a26e3c1-75b1-4cca-ae24-ef956c9e2eae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2eb6f4e4-3483-45a1-baf3-1f11787d1d06", "device": "/dev/sdb"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:17.539197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0a26e3c1-75b1-4cca-ae24-ef956c9e2eae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:17.548697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a26e3c1-75b1-4cca-ae24-ef956c9e2eae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:17.549282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a26e3c1-75b1-4cca-ae24-ef956c9e2eae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:17.550219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a26e3c1-75b1-4cca-ae24-ef956c9e2eae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:17.550648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a26e3c1-75b1-4cca-ae24-ef956c9e2eae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:17.815563 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0a26e3c1-75b1-4cca-ae24-ef956c9e2eae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "POST /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284195 Jul 04 05:58:17.820992 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 287/585] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jul 4 05:58:17 2022] POST /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:58:17.970575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-22ead7fc-b262-4484-aceb-a604737ff714 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:17.971417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-22ead7fc-b262-4484-aceb-a604737ff714 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:17.978035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22ead7fc-b262-4484-aceb-a604737ff714 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:17.978580 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22ead7fc-b262-4484-aceb-a604737ff714 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:17.979394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22ead7fc-b262-4484-aceb-a604737ff714 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:17.979865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22ead7fc-b262-4484-aceb-a604737ff714 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:18.012454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-22ead7fc-b262-4484-aceb-a604737ff714 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046182 Jul 04 05:58:18.013020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 299/586] 10.222.0.42 () {60 vars in 1342 bytes} [Mon Jul 4 05:58:17 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:18.070814 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2c8094dd-c0b4-4fc0-a8d1-e21b4ee851ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:18.071383 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2c8094dd-c0b4-4fc0-a8d1-e21b4ee851ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:18.078251 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8094dd-c0b4-4fc0-a8d1-e21b4ee851ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:18.078695 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8094dd-c0b4-4fc0-a8d1-e21b4ee851ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:18.079519 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8094dd-c0b4-4fc0-a8d1-e21b4ee851ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:18.079942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8094dd-c0b4-4fc0-a8d1-e21b4ee851ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:18.105343 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2c8094dd-c0b4-4fc0-a8d1-e21b4ee851ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 05:58:18.193257 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2c8094dd-c0b4-4fc0-a8d1-e21b4ee851ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "DELETE /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 204 len: 0 microversion: 2.20 time: 0.126979 Jul 04 05:58:18.194161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 288/587] 10.222.0.42 () {60 vars in 1279 bytes} [Mon Jul 4 05:58:18 2022] DELETE /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 05:58:18.203522 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-63168f04-cecd-438b-a290-2b33a0ce2743 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:18.204119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-63168f04-cecd-438b-a290-2b33a0ce2743 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:18.211622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63168f04-cecd-438b-a290-2b33a0ce2743 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:18.211735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63168f04-cecd-438b-a290-2b33a0ce2743 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:18.212810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63168f04-cecd-438b-a290-2b33a0ce2743 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:18.213260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63168f04-cecd-438b-a290-2b33a0ce2743 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:18.216758 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3b22ba3b-2b45-4876-924a-a2c2e7f9ea0a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:18.217498 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3b22ba3b-2b45-4876-924a-a2c2e7f9ea0a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:18.224461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b22ba3b-2b45-4876-924a-a2c2e7f9ea0a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:18.224914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b22ba3b-2b45-4876-924a-a2c2e7f9ea0a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:18.225694 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b22ba3b-2b45-4876-924a-a2c2e7f9ea0a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:18.226177 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b22ba3b-2b45-4876-924a-a2c2e7f9ea0a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:18.351923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-63168f04-cecd-438b-a290-2b33a0ce2743 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:18.362009 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-63168f04-cecd-438b-a290-2b33a0ce2743 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:18.363810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-63168f04-cecd-438b-a290-2b33a0ce2743 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:18.367337 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3b22ba3b-2b45-4876-924a-a2c2e7f9ea0a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:18.368668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-63168f04-cecd-438b-a290-2b33a0ce2743 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.169025 Jul 04 05:58:18.369970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 300/588] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:18 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:18.376105 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3b22ba3b-2b45-4876-924a-a2c2e7f9ea0a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.165058 Jul 04 05:58:18.376798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 289/589] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:18 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:19.391270 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4b65b87a-5918-4e00-88f0-36bf42299d26 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:19.392179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4b65b87a-5918-4e00-88f0-36bf42299d26 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:19.395724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:19.395977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7ef43aeb-dce5-4d5a-af16-646f0f589175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:19.396790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7ef43aeb-dce5-4d5a-af16-646f0f589175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:19.404878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b65b87a-5918-4e00-88f0-36bf42299d26 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:19.405686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b65b87a-5918-4e00-88f0-36bf42299d26 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:19.405928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ef43aeb-dce5-4d5a-af16-646f0f589175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:19.406539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ef43aeb-dce5-4d5a-af16-646f0f589175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:19.407057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b65b87a-5918-4e00-88f0-36bf42299d26 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:19.407681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ef43aeb-dce5-4d5a-af16-646f0f589175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:19.407883 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b65b87a-5918-4e00-88f0-36bf42299d26 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:19.408306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ef43aeb-dce5-4d5a-af16-646f0f589175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:19.540642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7ef43aeb-dce5-4d5a-af16-646f0f589175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:19.546531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4b65b87a-5918-4e00-88f0-36bf42299d26 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:19.549126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7ef43aeb-dce5-4d5a-af16-646f0f589175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.158790 Jul 04 05:58:19.555365 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 290/590] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:19 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:19.556237 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4b65b87a-5918-4e00-88f0-36bf42299d26 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:19.557735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4b65b87a-5918-4e00-88f0-36bf42299d26 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:19.558881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4b65b87a-5918-4e00-88f0-36bf42299d26 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.173368 Jul 04 05:58:19.559453 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 301/591] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:19 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:20.567682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-29975a80-ecf8-4297-b9ca-8bfaff5ea03a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:20.568486 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-29975a80-ecf8-4297-b9ca-8bfaff5ea03a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:20.576259 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29975a80-ecf8-4297-b9ca-8bfaff5ea03a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:20.576630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29975a80-ecf8-4297-b9ca-8bfaff5ea03a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:20.577535 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29975a80-ecf8-4297-b9ca-8bfaff5ea03a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:20.577691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-673217f8-4027-4a8a-917f-f87728684456 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:20.578132 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29975a80-ecf8-4297-b9ca-8bfaff5ea03a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:20.578267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-673217f8-4027-4a8a-917f-f87728684456 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:20.585369 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-673217f8-4027-4a8a-917f-f87728684456 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:20.585918 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-673217f8-4027-4a8a-917f-f87728684456 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:20.586945 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-673217f8-4027-4a8a-917f-f87728684456 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:20.587390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-673217f8-4027-4a8a-917f-f87728684456 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:20.714373 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-29975a80-ecf8-4297-b9ca-8bfaff5ea03a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:20.722214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-29975a80-ecf8-4297-b9ca-8bfaff5ea03a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.159333 Jul 04 05:58:20.722796 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 291/592] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:20 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:20.780082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-673217f8-4027-4a8a-917f-f87728684456 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:20.788733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-673217f8-4027-4a8a-917f-f87728684456 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:20.790419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-673217f8-4027-4a8a-917f-f87728684456 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:20.791682 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-673217f8-4027-4a8a-917f-f87728684456 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 200 len: 1722 microversion: 2.20 time: 0.218577 Jul 04 05:58:20.792594 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 302/593] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:20 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:58:21.113830 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-6d72706a-2823-40ec-b11e-8d5a73a49c21 req-951654df-7b1f-4989-a08b-fc6b03ed7c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178121f0-a865-467e-a46a-069b621b6d17", "name": "network-vif-deleted", "tag": "27020a65-ee8e-4790-a27b-3983dfc85818"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:21.122264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6d72706a-2823-40ec-b11e-8d5a73a49c21 req-951654df-7b1f-4989-a08b-fc6b03ed7c6b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:21.122699 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6d72706a-2823-40ec-b11e-8d5a73a49c21 req-951654df-7b1f-4989-a08b-fc6b03ed7c6b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:21.134289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-6d72706a-2823-40ec-b11e-8d5a73a49c21 req-951654df-7b1f-4989-a08b-fc6b03ed7c6b service nova] Creating event network-vif-deleted:27020a65-ee8e-4790-a27b-3983dfc85818 for instance 178121f0-a865-467e-a46a-069b621b6d17 on hv-cinder-79733 Jul 04 05:58:21.139738 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-6d72706a-2823-40ec-b11e-8d5a73a49c21 req-951654df-7b1f-4989-a08b-fc6b03ed7c6b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031459 Jul 04 05:58:21.140526 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 292/594] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:58:21.740234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0ece3249-14ba-47b2-8db3-309ea12b3e19 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:21.740838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0ece3249-14ba-47b2-8db3-309ea12b3e19 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:21.747555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ece3249-14ba-47b2-8db3-309ea12b3e19 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:21.747993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ece3249-14ba-47b2-8db3-309ea12b3e19 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:21.748744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ece3249-14ba-47b2-8db3-309ea12b3e19 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:21.749170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ece3249-14ba-47b2-8db3-309ea12b3e19 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:21.811347 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c34ff664-1ec4-4141-966b-fdca115e236e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:21.812706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c34ff664-1ec4-4141-966b-fdca115e236e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:21.814719 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:21.821281 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c34ff664-1ec4-4141-966b-fdca115e236e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:21.821799 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c34ff664-1ec4-4141-966b-fdca115e236e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:21.822597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c34ff664-1ec4-4141-966b-fdca115e236e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:21.822986 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c34ff664-1ec4-4141-966b-fdca115e236e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:21.838513 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-c34ff664-1ec4-4141-966b-fdca115e236e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] HTTP exception thrown: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c34ff664-1ec4-4141-966b-fdca115e236e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Request method failure captured: Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 HTTP/1.1 Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoB8bKsJbNvGOnJjkpXV9bswTHj3lvwmYf__bTpxb2VlLNE2omAzkDjdRLHE1uFhHtcDQ1zYoQVE7lUvW_r_RK0AyDeSWrYbMF_qOnsoDGhYORcDduFofYuPv_uj9uZoyMIkGuP-AxfvlL4ICDPHroDYuGc-vuMdyYkjQJ4MJ96ufkc Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 05:58:21.840196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 982651a870c44a07bc4df322919e605e Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 05:58:21.841889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '178121f0-a865-467e-a46a-069b621b6d17'} Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:58:21.842920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 05:58:21.844438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 05:58:21.846405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c34ff664-1ec4-4141-966b-fdca115e236e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Returning 404 to user: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:58:21.847324 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c34ff664-1ec4-4141-966b-fdca115e236e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 404 len: 111 microversion: 2.20 time: 0.040806 Jul 04 05:58:21.848034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 293/595] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:21 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 05:58:21.856628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-30b66cab-ffbf-4b5d-b2a0-120aa717d5c3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '.version_select at 0x7f2047608790>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:21.877642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-30b66cab-ffbf-4b5d-b2a0-120aa717d5c3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-220569195" status: 204 len: 0 microversion: 2.20 time: 0.024962 Jul 04 05:58:21.878251 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 294/596] 10.222.0.42 () {60 vars in 1258 bytes} [Mon Jul 4 05:58:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-220569195 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 04 05:58:21.888802 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0ece3249-14ba-47b2-8db3-309ea12b3e19 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:21.897716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0ece3249-14ba-47b2-8db3-309ea12b3e19 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.161306 Jul 04 05:58:21.898538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 303/597] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:21 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:22.487507 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5085ba11-f2a0-4fa7-b0d5-48709e07e7e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Action: 'create', calling method: .version_select at 0x7f20476a25e0>, body: {"keypair": {"name": "tempest-keypair-673075183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCwwWmSOEuHeoBTHHH8gg8506XjMa4xdAe0GMWU4CuyVT8kVeU7aEUVw7IftrnoTkUR0ImbdAP0Sfj65tRRIyXm2hI+SQdD2ujzf3CqiSv/dXc78Z/lpqxX/NtfCXmF6Q=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:22.501815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-5085ba11-f2a0-4fa7-b0d5-48709e07e7e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Getting quotas for project f3251b70a6c64287acc95cc99d4e3b4d. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:58:22.506154 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-5085ba11-f2a0-4fa7-b0d5-48709e07e7e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Getting quotas for user 982651a870c44a07bc4df322919e605e and project f3251b70a6c64287acc95cc99d4e3b4d. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:58:22.528982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5085ba11-f2a0-4fa7-b0d5-48709e07e7e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045505 Jul 04 05:58:22.529526 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 295/598] 10.222.0.42 () {62 vars in 1199 bytes} [Mon Jul 4 05:58:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 04 05:58:22.915996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-34bb2403-3984-4904-9388-55a8bd7866b6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:22.916609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-34bb2403-3984-4904-9388-55a8bd7866b6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:22.923368 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34bb2403-3984-4904-9388-55a8bd7866b6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:22.923810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34bb2403-3984-4904-9388-55a8bd7866b6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:22.924575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34bb2403-3984-4904-9388-55a8bd7866b6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:22.925004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34bb2403-3984-4904-9388-55a8bd7866b6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:23.132215 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-34bb2403-3984-4904-9388-55a8bd7866b6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:23.140424 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-34bb2403-3984-4904-9388-55a8bd7866b6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.229293 Jul 04 05:58:23.141297 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 304/599] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:22 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:23.489305 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7fed532e-95ac-4861-89f5-ffd59e05df5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "894fb4af-f3ce-4764-814d-ad6e790e7fa5"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:23.490530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7fed532e-95ac-4861-89f5-ffd59e05df5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:23.508537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fed532e-95ac-4861-89f5-ffd59e05df5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:23.508987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fed532e-95ac-4861-89f5-ffd59e05df5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:23.509779 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fed532e-95ac-4861-89f5-ffd59e05df5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:23.510239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fed532e-95ac-4861-89f5-ffd59e05df5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:23.785787 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7fed532e-95ac-4861-89f5-ffd59e05df5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301644 Jul 04 05:58:23.786615 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 296/600] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jul 4 05:58:23 2022] POST /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:58:23.876937 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-439600407", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52917e3a-98b6-48ca-9924-af082e54387c"}], "security_groups": [{"name": "tempest-securitygroup--518073860"}], "key_name": "tempest-keypair-673075183", "user_data": "}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:23.986771 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] validate_networks() for [('52917e3a-98b6-48ca-9924-af082e54387c', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:58:24.158978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-43f596ed-dbe4-4bf5-b6b9-f2879468dc0d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:24.159762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-43f596ed-dbe4-4bf5-b6b9-f2879468dc0d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:24.166478 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43f596ed-dbe4-4bf5-b6b9-f2879468dc0d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:24.167379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43f596ed-dbe4-4bf5-b6b9-f2879468dc0d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:24.168229 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43f596ed-dbe4-4bf5-b6b9-f2879468dc0d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:24.168723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43f596ed-dbe4-4bf5-b6b9-f2879468dc0d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:24.305426 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-43f596ed-dbe4-4bf5-b6b9-f2879468dc0d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:24.313163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-43f596ed-dbe4-4bf5-b6b9-f2879468dc0d tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.158895 Jul 04 05:58:24.313723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 297/601] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:24 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:24.378113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:58:24.378680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:58:24.379334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:58:24.379923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:58:24.380567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:58:24.394868 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:24.395593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:24.396669 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:24.397096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:24.414716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Getting quotas for project f3251b70a6c64287acc95cc99d4e3b4d. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:58:24.419786 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Getting quotas for user 982651a870c44a07bc4df322919e605e and project f3251b70a6c64287acc95cc99d4e3b4d. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:58:24.434277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:58:24.437185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:58:24.486098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c9bd3733-aa3e-42e1-9895-deb02f4612be tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.613329 Jul 04 05:58:24.487033 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 305/602] 10.222.0.42 () {62 vars in 1187 bytes} [Mon Jul 4 05:58:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 04 05:58:24.497157 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f754d681-460c-406a-9257-36786c4f2926 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:24.497698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f754d681-460c-406a-9257-36786c4f2926 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:24.558988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f754d681-460c-406a-9257-36786c4f2926 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:24.566676 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f754d681-460c-406a-9257-36786c4f2926 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:24.568501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f754d681-460c-406a-9257-36786c4f2926 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:24.569826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f754d681-460c-406a-9257-36786c4f2926 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1280 microversion: 2.20 time: 0.076765 Jul 04 05:58:24.570711 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 298/603] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:24 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:58:24.698957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-57309195", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-426821201", "security_groups": [{"name": "tempest-secgroup-smoke-959486138"}], "block_device_mapping_v2": [{"uuid": "5dd9d0a0-5a41-40c2-96ec-f3c81887c75f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a228346-bcc6-4455-8ade-aec0773af28b"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:24.817147 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] validate_networks() for [('6a228346-bcc6-4455-8ade-aec0773af28b', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 05:58:25.197479 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 05:58:25.198056 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 05:58:25.198387 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 05:58:25.198796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 05:58:25.199313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 05:58:25.210391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:25.211022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:25.211854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:25.212293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:25.231627 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Getting quotas for project 8d701a66ecbb480fa08e97f304acf57b. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 05:58:25.235397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Getting quotas for user 6ac9756c145040e58f9d914ba5bcdfaa and project 8d701a66ecbb480fa08e97f304acf57b. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 05:58:25.299725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 05:58:25.301995 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5dd9d0a0-5a41-40c2-96ec-f3c81887c75f',volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 05:58:25.330551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f676b6f9-aca7-4275-9413-dead7335bbef tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:25.331275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f676b6f9-aca7-4275-9413-dead7335bbef tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:25.338505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f676b6f9-aca7-4275-9413-dead7335bbef tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:25.338954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f676b6f9-aca7-4275-9413-dead7335bbef tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:25.339763 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f676b6f9-aca7-4275-9413-dead7335bbef tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:25.340201 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f676b6f9-aca7-4275-9413-dead7335bbef tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:25.355544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:25.441696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-de755a34-b0b7-4600-a4c7-a52a70d34cef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747797 Jul 04 05:58:25.442677 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 306/604] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 05:58:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 05:58:25.453387 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-163441b4-9209-4a23-b38a-ca0ffd6273a4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:25.454001 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-163441b4-9209-4a23-b38a-ca0ffd6273a4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:25.482936 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f676b6f9-aca7-4275-9413-dead7335bbef tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:25.491360 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f676b6f9-aca7-4275-9413-dead7335bbef tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.164949 Jul 04 05:58:25.491751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 299/605] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:25 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:25.512699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-163441b4-9209-4a23-b38a-ca0ffd6273a4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:25.520452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-163441b4-9209-4a23-b38a-ca0ffd6273a4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1092 microversion: 2.1 time: 0.070917 Jul 04 05:58:25.521049 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 307/606] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:25 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1092 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:25.588885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0a0bf0af-cdae-4288-a9de-98ae28774c4c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:25.589775 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0a0bf0af-cdae-4288-a9de-98ae28774c4c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:25.598010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a0bf0af-cdae-4288-a9de-98ae28774c4c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:25.598792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a0bf0af-cdae-4288-a9de-98ae28774c4c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:25.600623 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a0bf0af-cdae-4288-a9de-98ae28774c4c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:25.601427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a0bf0af-cdae-4288-a9de-98ae28774c4c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:25.671768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0a0bf0af-cdae-4288-a9de-98ae28774c4c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:25.683331 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0a0bf0af-cdae-4288-a9de-98ae28774c4c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:25.685093 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0a0bf0af-cdae-4288-a9de-98ae28774c4c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:25.686484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0a0bf0af-cdae-4288-a9de-98ae28774c4c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1276 microversion: 2.20 time: 0.102024 Jul 04 05:58:25.687517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 300/607] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:25 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:26.509694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-64d5657e-2428-497e-bba5-a778cf7af9b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:26.510468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-64d5657e-2428-497e-bba5-a778cf7af9b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:26.519373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64d5657e-2428-497e-bba5-a778cf7af9b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:26.519522 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64d5657e-2428-497e-bba5-a778cf7af9b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:26.520458 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64d5657e-2428-497e-bba5-a778cf7af9b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:26.521305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64d5657e-2428-497e-bba5-a778cf7af9b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:26.542495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-98f4989b-a204-43db-874f-e8f3e0a74800 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:26.546610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-98f4989b-a204-43db-874f-e8f3e0a74800 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:26.565514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98f4989b-a204-43db-874f-e8f3e0a74800 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:26.566197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98f4989b-a204-43db-874f-e8f3e0a74800 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:26.567711 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98f4989b-a204-43db-874f-e8f3e0a74800 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:26.568531 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98f4989b-a204-43db-874f-e8f3e0a74800 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:26.657917 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-98f4989b-a204-43db-874f-e8f3e0a74800 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:26.665506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-98f4989b-a204-43db-874f-e8f3e0a74800 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1190 microversion: 2.1 time: 0.131992 Jul 04 05:58:26.666319 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 301/608] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:26 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1190 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:26.704728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-72ee7a00-6b42-4358-8d38-0a7313ca308d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:26.705688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-72ee7a00-6b42-4358-8d38-0a7313ca308d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:26.712792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ee7a00-6b42-4358-8d38-0a7313ca308d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:26.713551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ee7a00-6b42-4358-8d38-0a7313ca308d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:26.714517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ee7a00-6b42-4358-8d38-0a7313ca308d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:26.715137 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ee7a00-6b42-4358-8d38-0a7313ca308d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:26.745831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-64d5657e-2428-497e-bba5-a778cf7af9b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:26.756155 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-64d5657e-2428-497e-bba5-a778cf7af9b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.251243 Jul 04 05:58:26.757053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 308/609] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:26 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:26.803681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72ee7a00-6b42-4358-8d38-0a7313ca308d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:26.820277 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72ee7a00-6b42-4358-8d38-0a7313ca308d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:26.821737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72ee7a00-6b42-4358-8d38-0a7313ca308d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:26.822870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-72ee7a00-6b42-4358-8d38-0a7313ca308d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1338 microversion: 2.20 time: 0.122328 Jul 04 05:58:26.823467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 302/610] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:26 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1338 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:27.686994 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-34e02fea-a5c0-4c6f-9c75-ea16b3654d3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:27.688444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-34e02fea-a5c0-4c6f-9c75-ea16b3654d3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:27.697174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e02fea-a5c0-4c6f-9c75-ea16b3654d3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:27.697625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e02fea-a5c0-4c6f-9c75-ea16b3654d3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:27.698416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e02fea-a5c0-4c6f-9c75-ea16b3654d3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:27.698843 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e02fea-a5c0-4c6f-9c75-ea16b3654d3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:27.768335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-34e02fea-a5c0-4c6f-9c75-ea16b3654d3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:27.773996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92270b81-4214-409d-b7c6-d3090fa95a3c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:27.774656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92270b81-4214-409d-b7c6-d3090fa95a3c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:27.776299 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-34e02fea-a5c0-4c6f-9c75-ea16b3654d3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1208 microversion: 2.1 time: 0.095637 Jul 04 05:58:27.776838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 309/611] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:27 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1208 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:27.781878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92270b81-4214-409d-b7c6-d3090fa95a3c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:27.782335 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92270b81-4214-409d-b7c6-d3090fa95a3c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:27.783118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92270b81-4214-409d-b7c6-d3090fa95a3c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:27.783607 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92270b81-4214-409d-b7c6-d3090fa95a3c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:27.841488 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a78ac937-2679-4706-b991-aac4b375cad3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:27.842089 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a78ac937-2679-4706-b991-aac4b375cad3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:27.848569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a78ac937-2679-4706-b991-aac4b375cad3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:27.849049 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a78ac937-2679-4706-b991-aac4b375cad3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:27.849900 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a78ac937-2679-4706-b991-aac4b375cad3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:27.850332 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a78ac937-2679-4706-b991-aac4b375cad3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:27.922657 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-92270b81-4214-409d-b7c6-d3090fa95a3c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:27.930284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92270b81-4214-409d-b7c6-d3090fa95a3c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.160102 Jul 04 05:58:27.930849 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 303/612] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:27 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:27.983922 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a78ac937-2679-4706-b991-aac4b375cad3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:27.994169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a78ac937-2679-4706-b991-aac4b375cad3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:27.995694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a78ac937-2679-4706-b991-aac4b375cad3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:27.996799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a78ac937-2679-4706-b991-aac4b375cad3 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.159395 Jul 04 05:58:27.997333 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 310/613] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:27 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:28.797951 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-384d5867-b4a4-408f-b75a-1f573b58901c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:28.798845 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-384d5867-b4a4-408f-b75a-1f573b58901c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:28.808923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-384d5867-b4a4-408f-b75a-1f573b58901c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:28.809376 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-384d5867-b4a4-408f-b75a-1f573b58901c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:28.810156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-384d5867-b4a4-408f-b75a-1f573b58901c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:28.810593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-384d5867-b4a4-408f-b75a-1f573b58901c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:28.880597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-384d5867-b4a4-408f-b75a-1f573b58901c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:28.888566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-384d5867-b4a4-408f-b75a-1f573b58901c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1208 microversion: 2.1 time: 0.097688 Jul 04 05:58:28.889138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 304/614] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:28 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:28.948208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ccb5feb3-4ae4-4813-b6a9-89dc1bd5c666 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:28.948809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ccb5feb3-4ae4-4813-b6a9-89dc1bd5c666 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:28.960481 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccb5feb3-4ae4-4813-b6a9-89dc1bd5c666 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:28.961173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccb5feb3-4ae4-4813-b6a9-89dc1bd5c666 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:28.962468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccb5feb3-4ae4-4813-b6a9-89dc1bd5c666 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:28.963155 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccb5feb3-4ae4-4813-b6a9-89dc1bd5c666 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:29.017533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-af4ca02d-b9bd-4ae8-9971-bb9e1ee0cbdb tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:29.018139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-af4ca02d-b9bd-4ae8-9971-bb9e1ee0cbdb tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:29.024507 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af4ca02d-b9bd-4ae8-9971-bb9e1ee0cbdb tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:29.024962 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af4ca02d-b9bd-4ae8-9971-bb9e1ee0cbdb tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:29.025762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af4ca02d-b9bd-4ae8-9971-bb9e1ee0cbdb tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:29.026200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af4ca02d-b9bd-4ae8-9971-bb9e1ee0cbdb tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:29.106861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ccb5feb3-4ae4-4813-b6a9-89dc1bd5c666 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:29.114867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ccb5feb3-4ae4-4813-b6a9-89dc1bd5c666 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1675 microversion: 2.1 time: 0.170544 Jul 04 05:58:29.115780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 311/615] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:28 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:29.158948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-af4ca02d-b9bd-4ae8-9971-bb9e1ee0cbdb tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:29.167479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-af4ca02d-b9bd-4ae8-9971-bb9e1ee0cbdb tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:29.168966 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-af4ca02d-b9bd-4ae8-9971-bb9e1ee0cbdb tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:29.170105 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-af4ca02d-b9bd-4ae8-9971-bb9e1ee0cbdb tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.156586 Jul 04 05:58:29.170659 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 305/616] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:29 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:29.906246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e80c63f9-e161-448f-82a2-9904b4968b29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:29.907111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e80c63f9-e161-448f-82a2-9904b4968b29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:29.914112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e80c63f9-e161-448f-82a2-9904b4968b29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:29.914553 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e80c63f9-e161-448f-82a2-9904b4968b29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:29.915561 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e80c63f9-e161-448f-82a2-9904b4968b29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:29.915996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e80c63f9-e161-448f-82a2-9904b4968b29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:29.934301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:29.991404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e80c63f9-e161-448f-82a2-9904b4968b29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:30.006959 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e80c63f9-e161-448f-82a2-9904b4968b29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1208 microversion: 2.1 time: 0.104941 Jul 04 05:58:30.020639 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 312/617] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:29 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1208 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:30.131506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d597d0ba-b62c-4f33-aad2-f964e6b81de3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:30.132764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d597d0ba-b62c-4f33-aad2-f964e6b81de3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:30.140459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d597d0ba-b62c-4f33-aad2-f964e6b81de3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:30.140908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d597d0ba-b62c-4f33-aad2-f964e6b81de3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:30.141925 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d597d0ba-b62c-4f33-aad2-f964e6b81de3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:30.142358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d597d0ba-b62c-4f33-aad2-f964e6b81de3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:30.188107 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8649cbe1-f3df-4529-85d1-840c2e5d63f7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:30.188583 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8649cbe1-f3df-4529-85d1-840c2e5d63f7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:30.199500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8649cbe1-f3df-4529-85d1-840c2e5d63f7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:30.200248 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8649cbe1-f3df-4529-85d1-840c2e5d63f7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:30.201244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8649cbe1-f3df-4529-85d1-840c2e5d63f7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:30.201832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8649cbe1-f3df-4529-85d1-840c2e5d63f7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:30.358318 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d597d0ba-b62c-4f33-aad2-f964e6b81de3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:30.367040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d597d0ba-b62c-4f33-aad2-f964e6b81de3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1652 microversion: 2.1 time: 0.239479 Jul 04 05:58:30.368054 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 306/618] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:30 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1652 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:30.386384 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2f29302c-fb74-4dd0-b8a5-58923798c05e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:30.392981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f29302c-fb74-4dd0-b8a5-58923798c05e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:30.393683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f29302c-fb74-4dd0-b8a5-58923798c05e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:30.429474 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2f29302c-fb74-4dd0-b8a5-58923798c05e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Going to try to start instance {{(pid=117606) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 05:58:30.454155 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8649cbe1-f3df-4529-85d1-840c2e5d63f7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:30.463575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8649cbe1-f3df-4529-85d1-840c2e5d63f7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:30.465666 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8649cbe1-f3df-4529-85d1-840c2e5d63f7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:30.473260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8649cbe1-f3df-4529-85d1-840c2e5d63f7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.289726 Jul 04 05:58:30.476577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 313/619] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:30 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 05:58:30.521858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2f29302c-fb74-4dd0-b8a5-58923798c05e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "POST /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/action" status: 202 len: 0 microversion: 2.1 time: 0.137891 Jul 04 05:58:30.522493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 307/620] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 05:58:30 2022] POST /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:58:30.531285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8770f0e5-5ed7-454a-89af-51692c6742b4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:30.532270 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8770f0e5-5ed7-454a-89af-51692c6742b4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:30.544135 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8770f0e5-5ed7-454a-89af-51692c6742b4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:30.545579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8770f0e5-5ed7-454a-89af-51692c6742b4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:30.546729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8770f0e5-5ed7-454a-89af-51692c6742b4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:30.547396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8770f0e5-5ed7-454a-89af-51692c6742b4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:30.574790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-fd87adbc-5be3-47d1-afa1-02d2c425fdc7 req-a0774c18-ebd9-4f97-948a-ff94a87fd037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87fa4b2-597e-431a-bd5e-45f8c7395529", "tag": "787e112a-b1bf-41ce-b99d-6c3254cfc3aa"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:30.589096 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-fd87adbc-5be3-47d1-afa1-02d2c425fdc7 req-a0774c18-ebd9-4f97-948a-ff94a87fd037 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:30.591199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-fd87adbc-5be3-47d1-afa1-02d2c425fdc7 req-a0774c18-ebd9-4f97-948a-ff94a87fd037 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:30.609830 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-fd87adbc-5be3-47d1-afa1-02d2c425fdc7 req-a0774c18-ebd9-4f97-948a-ff94a87fd037 service nova] Creating event network-changed:787e112a-b1bf-41ce-b99d-6c3254cfc3aa for instance a87fa4b2-597e-431a-bd5e-45f8c7395529 on hv-cinder-79733 Jul 04 05:58:30.625607 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-fd87adbc-5be3-47d1-afa1-02d2c425fdc7 req-a0774c18-ebd9-4f97-948a-ff94a87fd037 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057570 Jul 04 05:58:30.626715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 308/621] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 05:58:31.027147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c889e790-dcc6-4e6d-9929-2581342695a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:31.028424 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c889e790-dcc6-4e6d-9929-2581342695a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:31.035793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c889e790-dcc6-4e6d-9929-2581342695a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:31.036234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c889e790-dcc6-4e6d-9929-2581342695a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:31.037173 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c889e790-dcc6-4e6d-9929-2581342695a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:31.037753 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c889e790-dcc6-4e6d-9929-2581342695a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:31.215143 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8770f0e5-5ed7-454a-89af-51692c6742b4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:31.233078 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8770f0e5-5ed7-454a-89af-51692c6742b4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.699973 Jul 04 05:58:31.234480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 314/622] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:30 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:31.256150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c889e790-dcc6-4e6d-9929-2581342695a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:31.264873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c889e790-dcc6-4e6d-9929-2581342695a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.242025 Jul 04 05:58:31.270630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 309/623] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:31 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:31.445860 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-4d2dae42-1c48-4544-8f72-3d7b80b79251 req-17b02401-bfd5-433f-a39e-ed39d4bae307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062c25e3-dd25-4cec-ba2c-b7c41f7103c4", "tag": "9c38ad94-d258-4857-a072-c74d04ef81b9"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:58:31.455114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-4d2dae42-1c48-4544-8f72-3d7b80b79251 req-17b02401-bfd5-433f-a39e-ed39d4bae307 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:31.455588 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-4d2dae42-1c48-4544-8f72-3d7b80b79251 req-17b02401-bfd5-433f-a39e-ed39d4bae307 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:31.469240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-4d2dae42-1c48-4544-8f72-3d7b80b79251 req-17b02401-bfd5-433f-a39e-ed39d4bae307 service nova] Creating event network-changed:9c38ad94-d258-4857-a072-c74d04ef81b9 for instance 062c25e3-dd25-4cec-ba2c-b7c41f7103c4 on hv-cinder-79733 Jul 04 05:58:31.474356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-4d2dae42-1c48-4544-8f72-3d7b80b79251 req-17b02401-bfd5-433f-a39e-ed39d4bae307 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032450 Jul 04 05:58:31.474938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 315/624] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:58:31.491667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-364f8bdc-5a9c-4ba0-8270-93fc514fa66e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:31.492250 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-364f8bdc-5a9c-4ba0-8270-93fc514fa66e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:31.498688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-364f8bdc-5a9c-4ba0-8270-93fc514fa66e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:31.499134 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-364f8bdc-5a9c-4ba0-8270-93fc514fa66e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:31.499945 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-364f8bdc-5a9c-4ba0-8270-93fc514fa66e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:31.500358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-364f8bdc-5a9c-4ba0-8270-93fc514fa66e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:31.642996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-364f8bdc-5a9c-4ba0-8270-93fc514fa66e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:31.650944 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-364f8bdc-5a9c-4ba0-8270-93fc514fa66e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:31.652565 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-364f8bdc-5a9c-4ba0-8270-93fc514fa66e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:31.653664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-364f8bdc-5a9c-4ba0-8270-93fc514fa66e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.166071 Jul 04 05:58:31.654254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 310/625] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:31 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:32.256347 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7a803417-3987-45c7-9e39-8f68162eb1bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:32.257494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7a803417-3987-45c7-9e39-8f68162eb1bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:32.268757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a803417-3987-45c7-9e39-8f68162eb1bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:32.269494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a803417-3987-45c7-9e39-8f68162eb1bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:32.270834 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a803417-3987-45c7-9e39-8f68162eb1bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:32.271607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a803417-3987-45c7-9e39-8f68162eb1bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:32.282211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a6019623-2858-4433-8ff9-0576f91906cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:32.282814 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a6019623-2858-4433-8ff9-0576f91906cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:32.289803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6019623-2858-4433-8ff9-0576f91906cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:32.290241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6019623-2858-4433-8ff9-0576f91906cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:32.291003 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6019623-2858-4433-8ff9-0576f91906cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:32.292430 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6019623-2858-4433-8ff9-0576f91906cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:32.403903 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7a803417-3987-45c7-9e39-8f68162eb1bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:32.412730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7a803417-3987-45c7-9e39-8f68162eb1bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.163435 Jul 04 05:58:32.413430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 316/626] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:32 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:32.424872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6019623-2858-4433-8ff9-0576f91906cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:32.432575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a6019623-2858-4433-8ff9-0576f91906cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.154164 Jul 04 05:58:32.433144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 311/627] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:32 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:32.676285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8d2673c6-dd68-4bf3-a67a-89f44ef81790 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:32.677289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8d2673c6-dd68-4bf3-a67a-89f44ef81790 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:32.687723 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d2673c6-dd68-4bf3-a67a-89f44ef81790 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:32.688471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d2673c6-dd68-4bf3-a67a-89f44ef81790 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:32.689740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d2673c6-dd68-4bf3-a67a-89f44ef81790 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:32.690463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d2673c6-dd68-4bf3-a67a-89f44ef81790 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:32.830933 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8d2673c6-dd68-4bf3-a67a-89f44ef81790 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:32.839687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8d2673c6-dd68-4bf3-a67a-89f44ef81790 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:32.841743 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8d2673c6-dd68-4bf3-a67a-89f44ef81790 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:32.843896 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8d2673c6-dd68-4bf3-a67a-89f44ef81790 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.173851 Jul 04 05:58:32.844872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 317/628] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:32 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:33.431359 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-15ddbf82-6320-470c-8919-f6f948be4f7c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:33.431863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-15ddbf82-6320-470c-8919-f6f948be4f7c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:33.441115 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15ddbf82-6320-470c-8919-f6f948be4f7c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:33.441627 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15ddbf82-6320-470c-8919-f6f948be4f7c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:33.442501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15ddbf82-6320-470c-8919-f6f948be4f7c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:33.443276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15ddbf82-6320-470c-8919-f6f948be4f7c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:33.449480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b50ea1ab-7cd0-4743-acb2-3f57f87dc7a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:33.450178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b50ea1ab-7cd0-4743-acb2-3f57f87dc7a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:33.459700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b50ea1ab-7cd0-4743-acb2-3f57f87dc7a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:33.460154 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b50ea1ab-7cd0-4743-acb2-3f57f87dc7a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:33.460943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b50ea1ab-7cd0-4743-acb2-3f57f87dc7a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:33.461372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b50ea1ab-7cd0-4743-acb2-3f57f87dc7a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:33.584084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-15ddbf82-6320-470c-8919-f6f948be4f7c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:33.591647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-15ddbf82-6320-470c-8919-f6f948be4f7c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.164217 Jul 04 05:58:33.592191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 312/629] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:33 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:33.606516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b50ea1ab-7cd0-4743-acb2-3f57f87dc7a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:33.614288 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b50ea1ab-7cd0-4743-acb2-3f57f87dc7a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.168705 Jul 04 05:58:33.614853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 318/630] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:33 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:33.870816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d927a0a0-a529-45ee-b83f-640a2710f50a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:33.871460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d927a0a0-a529-45ee-b83f-640a2710f50a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:33.877951 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d927a0a0-a529-45ee-b83f-640a2710f50a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:33.878414 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d927a0a0-a529-45ee-b83f-640a2710f50a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:33.879184 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d927a0a0-a529-45ee-b83f-640a2710f50a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:33.879656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d927a0a0-a529-45ee-b83f-640a2710f50a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:34.022775 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d927a0a0-a529-45ee-b83f-640a2710f50a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:34.031496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d927a0a0-a529-45ee-b83f-640a2710f50a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:34.032996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d927a0a0-a529-45ee-b83f-640a2710f50a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:34.034110 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d927a0a0-a529-45ee-b83f-640a2710f50a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.169791 Jul 04 05:58:34.034674 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 313/631] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:33 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:34.613551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3610f782-70f7-4c66-8d7c-6662a4014e8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:34.614567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3610f782-70f7-4c66-8d7c-6662a4014e8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:34.623921 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3610f782-70f7-4c66-8d7c-6662a4014e8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:34.624378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3610f782-70f7-4c66-8d7c-6662a4014e8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:34.625180 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3610f782-70f7-4c66-8d7c-6662a4014e8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:34.625614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3610f782-70f7-4c66-8d7c-6662a4014e8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:34.631405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ec9e7282-15ea-4ca8-b934-0829f461ac84 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:34.632010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ec9e7282-15ea-4ca8-b934-0829f461ac84 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:34.634488 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:34.640254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec9e7282-15ea-4ca8-b934-0829f461ac84 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:34.640702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec9e7282-15ea-4ca8-b934-0829f461ac84 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:34.641586 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec9e7282-15ea-4ca8-b934-0829f461ac84 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:34.642137 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec9e7282-15ea-4ca8-b934-0829f461ac84 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:34.758009 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3610f782-70f7-4c66-8d7c-6662a4014e8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:34.765697 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3610f782-70f7-4c66-8d7c-6662a4014e8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.158603 Jul 04 05:58:34.766260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 319/632] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:34 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:34.773361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ec9e7282-15ea-4ca8-b934-0829f461ac84 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:34.781031 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ec9e7282-15ea-4ca8-b934-0829f461ac84 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.153649 Jul 04 05:58:34.781598 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 314/633] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:34 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:35.056844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-371a2aed-1fa3-4467-bcf7-7600388ec49f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:35.057849 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-371a2aed-1fa3-4467-bcf7-7600388ec49f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:35.068088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-371a2aed-1fa3-4467-bcf7-7600388ec49f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:35.068832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-371a2aed-1fa3-4467-bcf7-7600388ec49f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:35.070134 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-371a2aed-1fa3-4467-bcf7-7600388ec49f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:35.070824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-371a2aed-1fa3-4467-bcf7-7600388ec49f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:35.204499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-371a2aed-1fa3-4467-bcf7-7600388ec49f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:35.212837 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-371a2aed-1fa3-4467-bcf7-7600388ec49f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:35.214373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-371a2aed-1fa3-4467-bcf7-7600388ec49f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:35.215529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-371a2aed-1fa3-4467-bcf7-7600388ec49f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.165200 Jul 04 05:58:35.216098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 320/634] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:35 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:35.786268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d7fd27dc-d574-4146-999a-856f56293c88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:35.787184 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d7fd27dc-d574-4146-999a-856f56293c88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:35.796422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7fd27dc-d574-4146-999a-856f56293c88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:35.796867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7fd27dc-d574-4146-999a-856f56293c88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:35.797626 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7fd27dc-d574-4146-999a-856f56293c88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:35.797785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-658a0390-578b-4a5a-b813-2f1433c596d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:35.798191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7fd27dc-d574-4146-999a-856f56293c88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:35.798425 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-658a0390-578b-4a5a-b813-2f1433c596d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:35.800437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:35.801294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=14 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:35.808099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-658a0390-578b-4a5a-b813-2f1433c596d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:35.808550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-658a0390-578b-4a5a-b813-2f1433c596d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:35.809332 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-658a0390-578b-4a5a-b813-2f1433c596d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:35.809763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-658a0390-578b-4a5a-b813-2f1433c596d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:35.817331 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:35.937306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d7fd27dc-d574-4146-999a-856f56293c88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:35.943933 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-658a0390-578b-4a5a-b813-2f1433c596d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:35.945522 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d7fd27dc-d574-4146-999a-856f56293c88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.165821 Jul 04 05:58:35.946098 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 315/635] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:35 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:35.951681 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-658a0390-578b-4a5a-b813-2f1433c596d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.157631 Jul 04 05:58:35.952385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 321/636] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:35 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:36.240799 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e2134fda-36a8-4b69-9e66-ddaf7c475044 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:36.241835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e2134fda-36a8-4b69-9e66-ddaf7c475044 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:36.249754 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2134fda-36a8-4b69-9e66-ddaf7c475044 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:36.250206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2134fda-36a8-4b69-9e66-ddaf7c475044 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:36.250973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2134fda-36a8-4b69-9e66-ddaf7c475044 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:36.251460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2134fda-36a8-4b69-9e66-ddaf7c475044 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:36.399292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e2134fda-36a8-4b69-9e66-ddaf7c475044 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:36.407971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e2134fda-36a8-4b69-9e66-ddaf7c475044 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:36.409460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e2134fda-36a8-4b69-9e66-ddaf7c475044 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:36.410564 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e2134fda-36a8-4b69-9e66-ddaf7c475044 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.176641 Jul 04 05:58:36.411138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 316/637] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:36 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:36.966543 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-286b6cf7-49d0-4f75-bf52-325c568018fd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:36.967165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-286b6cf7-49d0-4f75-bf52-325c568018fd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:36.969402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fc5bc2ac-1c19-49ca-8451-bbdb7796c9a0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:36.970011 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fc5bc2ac-1c19-49ca-8451-bbdb7796c9a0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:36.973929 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-286b6cf7-49d0-4f75-bf52-325c568018fd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:36.974388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-286b6cf7-49d0-4f75-bf52-325c568018fd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:36.975146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-286b6cf7-49d0-4f75-bf52-325c568018fd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:36.975621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-286b6cf7-49d0-4f75-bf52-325c568018fd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:36.976633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc5bc2ac-1c19-49ca-8451-bbdb7796c9a0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:36.977086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc5bc2ac-1c19-49ca-8451-bbdb7796c9a0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:36.977846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc5bc2ac-1c19-49ca-8451-bbdb7796c9a0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:36.978280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc5bc2ac-1c19-49ca-8451-bbdb7796c9a0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:37.109021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-286b6cf7-49d0-4f75-bf52-325c568018fd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:37.109708 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fc5bc2ac-1c19-49ca-8451-bbdb7796c9a0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:37.117027 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-286b6cf7-49d0-4f75-bf52-325c568018fd tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.156328 Jul 04 05:58:37.117322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fc5bc2ac-1c19-49ca-8451-bbdb7796c9a0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.151783 Jul 04 05:58:37.117609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 322/638] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:36 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:37.118095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 317/639] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:36 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:37.433257 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e7bc1ba-a040-4ad7-a54b-6cedd738d3e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:37.434838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e7bc1ba-a040-4ad7-a54b-6cedd738d3e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:37.445504 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e7bc1ba-a040-4ad7-a54b-6cedd738d3e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:37.446253 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e7bc1ba-a040-4ad7-a54b-6cedd738d3e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:37.447609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e7bc1ba-a040-4ad7-a54b-6cedd738d3e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:37.448334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e7bc1ba-a040-4ad7-a54b-6cedd738d3e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:37.579207 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e7bc1ba-a040-4ad7-a54b-6cedd738d3e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:37.587391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e7bc1ba-a040-4ad7-a54b-6cedd738d3e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:37.588864 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e7bc1ba-a040-4ad7-a54b-6cedd738d3e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:37.590138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e7bc1ba-a040-4ad7-a54b-6cedd738d3e1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.163442 Jul 04 05:58:37.590687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 323/640] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:37 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:38.137944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-20c9d332-6919-46c9-8efe-65051a88417e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:38.138561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cd91fa41-afea-4752-b75d-31d53271d233 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:38.138561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cd91fa41-afea-4752-b75d-31d53271d233 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:38.139043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-20c9d332-6919-46c9-8efe-65051a88417e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:38.145530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd91fa41-afea-4752-b75d-31d53271d233 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:38.145707 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20c9d332-6919-46c9-8efe-65051a88417e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:38.145976 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd91fa41-afea-4752-b75d-31d53271d233 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:38.146136 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20c9d332-6919-46c9-8efe-65051a88417e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:38.146748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd91fa41-afea-4752-b75d-31d53271d233 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:38.146907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20c9d332-6919-46c9-8efe-65051a88417e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:38.147326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd91fa41-afea-4752-b75d-31d53271d233 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:38.147468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20c9d332-6919-46c9-8efe-65051a88417e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:38.279997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cd91fa41-afea-4752-b75d-31d53271d233 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:38.285831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20c9d332-6919-46c9-8efe-65051a88417e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:38.287792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cd91fa41-afea-4752-b75d-31d53271d233 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.155349 Jul 04 05:58:38.288574 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 318/641] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:38 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:38.295911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-20c9d332-6919-46c9-8efe-65051a88417e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.163543 Jul 04 05:58:38.296470 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 324/642] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:38 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:38.612120 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-880da961-3c59-4b98-bf6c-c4b8e4748780 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:38.613107 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-880da961-3c59-4b98-bf6c-c4b8e4748780 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:38.623290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-880da961-3c59-4b98-bf6c-c4b8e4748780 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:38.624109 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-880da961-3c59-4b98-bf6c-c4b8e4748780 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:38.625353 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-880da961-3c59-4b98-bf6c-c4b8e4748780 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:38.626081 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-880da961-3c59-4b98-bf6c-c4b8e4748780 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:38.762275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-880da961-3c59-4b98-bf6c-c4b8e4748780 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:38.770753 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-880da961-3c59-4b98-bf6c-c4b8e4748780 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:38.772388 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-880da961-3c59-4b98-bf6c-c4b8e4748780 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:38.774491 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-880da961-3c59-4b98-bf6c-c4b8e4748780 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.168633 Jul 04 05:58:38.775075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 319/643] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:38 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:39.306280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c1eb69f9-ba58-4b73-997c-b3730597d8c1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:39.306869 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c1eb69f9-ba58-4b73-997c-b3730597d8c1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:39.312778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-534546b5-d24b-4d60-b72e-3c416593266f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:39.313376 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-534546b5-d24b-4d60-b72e-3c416593266f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:39.314004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1eb69f9-ba58-4b73-997c-b3730597d8c1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:39.314455 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1eb69f9-ba58-4b73-997c-b3730597d8c1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:39.315230 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1eb69f9-ba58-4b73-997c-b3730597d8c1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:39.315694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1eb69f9-ba58-4b73-997c-b3730597d8c1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:39.320135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-534546b5-d24b-4d60-b72e-3c416593266f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:39.320556 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-534546b5-d24b-4d60-b72e-3c416593266f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:39.321419 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-534546b5-d24b-4d60-b72e-3c416593266f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:39.321848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-534546b5-d24b-4d60-b72e-3c416593266f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:39.446425 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c1eb69f9-ba58-4b73-997c-b3730597d8c1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:39.454277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c1eb69f9-ba58-4b73-997c-b3730597d8c1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.151942 Jul 04 05:58:39.454936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 325/644] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:39 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:39.462860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-534546b5-d24b-4d60-b72e-3c416593266f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:39.471697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-534546b5-d24b-4d60-b72e-3c416593266f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.162860 Jul 04 05:58:39.472262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 320/645] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:39 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:39.794511 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dc3f30a9-2783-4e20-8aa8-129726dbf1e7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:39.795102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dc3f30a9-2783-4e20-8aa8-129726dbf1e7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:39.801420 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc3f30a9-2783-4e20-8aa8-129726dbf1e7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:39.801863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc3f30a9-2783-4e20-8aa8-129726dbf1e7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:39.802628 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc3f30a9-2783-4e20-8aa8-129726dbf1e7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:39.803048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc3f30a9-2783-4e20-8aa8-129726dbf1e7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:39.933972 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dc3f30a9-2783-4e20-8aa8-129726dbf1e7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:39.942267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dc3f30a9-2783-4e20-8aa8-129726dbf1e7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:39.943768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dc3f30a9-2783-4e20-8aa8-129726dbf1e7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:39.944920 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dc3f30a9-2783-4e20-8aa8-129726dbf1e7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.154813 Jul 04 05:58:39.945560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 326/646] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:39 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:40.475084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7d02e416-f29c-46f9-aa0f-10ec1542e3f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:40.476125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7d02e416-f29c-46f9-aa0f-10ec1542e3f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:40.488075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d02e416-f29c-46f9-aa0f-10ec1542e3f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:40.488713 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d02e416-f29c-46f9-aa0f-10ec1542e3f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:40.489993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d02e416-f29c-46f9-aa0f-10ec1542e3f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:40.490722 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d02e416-f29c-46f9-aa0f-10ec1542e3f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:40.492932 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8af88c79-f91b-4b3d-8401-8ebaf29e6abb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:40.493930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8af88c79-f91b-4b3d-8401-8ebaf29e6abb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:40.501299 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8af88c79-f91b-4b3d-8401-8ebaf29e6abb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:40.501748 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8af88c79-f91b-4b3d-8401-8ebaf29e6abb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:40.502513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8af88c79-f91b-4b3d-8401-8ebaf29e6abb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:40.502945 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8af88c79-f91b-4b3d-8401-8ebaf29e6abb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:40.623713 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d02e416-f29c-46f9-aa0f-10ec1542e3f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:40.631486 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7d02e416-f29c-46f9-aa0f-10ec1542e3f8 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.162890 Jul 04 05:58:40.632093 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 321/647] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:40 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:40.642335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8af88c79-f91b-4b3d-8401-8ebaf29e6abb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:40.650480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8af88c79-f91b-4b3d-8401-8ebaf29e6abb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.164234 Jul 04 05:58:40.651084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 327/648] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:40 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:40.964540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-60c2efef-91ba-4861-a6a8-04a07746bdaa tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:40.965247 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-60c2efef-91ba-4861-a6a8-04a07746bdaa tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:40.972660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c2efef-91ba-4861-a6a8-04a07746bdaa tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:40.973192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c2efef-91ba-4861-a6a8-04a07746bdaa tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:40.974098 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c2efef-91ba-4861-a6a8-04a07746bdaa tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:40.974604 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c2efef-91ba-4861-a6a8-04a07746bdaa tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:41.123505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-60c2efef-91ba-4861-a6a8-04a07746bdaa tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:41.135834 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-60c2efef-91ba-4861-a6a8-04a07746bdaa tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:41.137442 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-60c2efef-91ba-4861-a6a8-04a07746bdaa tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:41.138582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-60c2efef-91ba-4861-a6a8-04a07746bdaa tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.178907 Jul 04 05:58:41.139165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 322/649] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:40 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:41.653035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8178c66e-e236-476b-93ac-4fb517649fc6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:41.654261 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8178c66e-e236-476b-93ac-4fb517649fc6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:41.665113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8178c66e-e236-476b-93ac-4fb517649fc6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:41.665850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8178c66e-e236-476b-93ac-4fb517649fc6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:41.667725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8178c66e-e236-476b-93ac-4fb517649fc6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:41.668203 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8178c66e-e236-476b-93ac-4fb517649fc6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:41.670193 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9a2e2b8c-a666-4faa-8a03-7aae104e4a97 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:41.670937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9a2e2b8c-a666-4faa-8a03-7aae104e4a97 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:41.677739 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a2e2b8c-a666-4faa-8a03-7aae104e4a97 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:41.678187 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a2e2b8c-a666-4faa-8a03-7aae104e4a97 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:41.678996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a2e2b8c-a666-4faa-8a03-7aae104e4a97 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:41.679482 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a2e2b8c-a666-4faa-8a03-7aae104e4a97 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:41.800857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8178c66e-e236-476b-93ac-4fb517649fc6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:41.808700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8178c66e-e236-476b-93ac-4fb517649fc6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.162251 Jul 04 05:58:41.809276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 328/650] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:41 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:41.810596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a2e2b8c-a666-4faa-8a03-7aae104e4a97 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:41.818942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9a2e2b8c-a666-4faa-8a03-7aae104e4a97 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.154047 Jul 04 05:58:41.819133 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 323/651] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:41 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:42.161041 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-71ce2687-7061-47e2-96f0-8c552e1fab22 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:42.161928 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-71ce2687-7061-47e2-96f0-8c552e1fab22 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:42.172671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71ce2687-7061-47e2-96f0-8c552e1fab22 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:42.173414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71ce2687-7061-47e2-96f0-8c552e1fab22 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:42.174677 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71ce2687-7061-47e2-96f0-8c552e1fab22 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:42.175478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71ce2687-7061-47e2-96f0-8c552e1fab22 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:42.319999 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-71ce2687-7061-47e2-96f0-8c552e1fab22 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:42.323451 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:42.329430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-71ce2687-7061-47e2-96f0-8c552e1fab22 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:42.330898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-71ce2687-7061-47e2-96f0-8c552e1fab22 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:42.332027 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-71ce2687-7061-47e2-96f0-8c552e1fab22 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.177686 Jul 04 05:58:42.332577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 329/652] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:42 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:42.830263 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e3dabbd-e105-4323-bc27-d3a4e2989346 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:42.831234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e3dabbd-e105-4323-bc27-d3a4e2989346 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:42.839622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cd969c68-7b16-43b6-ac12-2c89ab65773c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:42.840476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cd969c68-7b16-43b6-ac12-2c89ab65773c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:42.842004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e3dabbd-e105-4323-bc27-d3a4e2989346 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:42.842549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e3dabbd-e105-4323-bc27-d3a4e2989346 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:42.843575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e3dabbd-e105-4323-bc27-d3a4e2989346 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:42.844064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e3dabbd-e105-4323-bc27-d3a4e2989346 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:42.847861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd969c68-7b16-43b6-ac12-2c89ab65773c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:42.848422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd969c68-7b16-43b6-ac12-2c89ab65773c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:42.849353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd969c68-7b16-43b6-ac12-2c89ab65773c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:42.849777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd969c68-7b16-43b6-ac12-2c89ab65773c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:42.979695 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6e3dabbd-e105-4323-bc27-d3a4e2989346 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:42.984097 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cd969c68-7b16-43b6-ac12-2c89ab65773c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:42.987214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e3dabbd-e105-4323-bc27-d3a4e2989346 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.164405 Jul 04 05:58:42.987812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 324/653] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:42 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:42.991872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cd969c68-7b16-43b6-ac12-2c89ab65773c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.159322 Jul 04 05:58:42.992422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 330/654] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:42 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:43.349982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b87ed04e-20b8-44d5-8f01-3964bc6f036a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:43.350577 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b87ed04e-20b8-44d5-8f01-3964bc6f036a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:43.357082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b87ed04e-20b8-44d5-8f01-3964bc6f036a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:43.357526 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b87ed04e-20b8-44d5-8f01-3964bc6f036a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:43.358278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b87ed04e-20b8-44d5-8f01-3964bc6f036a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:43.358706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b87ed04e-20b8-44d5-8f01-3964bc6f036a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:43.495203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b87ed04e-20b8-44d5-8f01-3964bc6f036a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:43.505017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b87ed04e-20b8-44d5-8f01-3964bc6f036a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:43.506639 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b87ed04e-20b8-44d5-8f01-3964bc6f036a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:43.507837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b87ed04e-20b8-44d5-8f01-3964bc6f036a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.161777 Jul 04 05:58:43.508783 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 325/655] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:43 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:44.004757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-68a20312-c942-4427-9477-c543566add88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:44.005868 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-68a20312-c942-4427-9477-c543566add88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:44.009787 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-654ec622-dc31-4076-a39b-88a8a1b74b5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:44.010362 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-654ec622-dc31-4076-a39b-88a8a1b74b5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:44.013426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68a20312-c942-4427-9477-c543566add88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:44.013875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68a20312-c942-4427-9477-c543566add88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:44.014649 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68a20312-c942-4427-9477-c543566add88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:44.015080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68a20312-c942-4427-9477-c543566add88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:44.017627 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-654ec622-dc31-4076-a39b-88a8a1b74b5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:44.018103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-654ec622-dc31-4076-a39b-88a8a1b74b5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:44.020301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-654ec622-dc31-4076-a39b-88a8a1b74b5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:44.020301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-654ec622-dc31-4076-a39b-88a8a1b74b5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:44.144780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68a20312-c942-4427-9477-c543566add88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:44.146666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-654ec622-dc31-4076-a39b-88a8a1b74b5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:44.152654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-68a20312-c942-4427-9477-c543566add88 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.151885 Jul 04 05:58:44.153231 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 331/656] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:43 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:44.154201 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-654ec622-dc31-4076-a39b-88a8a1b74b5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.148991 Jul 04 05:58:44.154748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 326/657] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:44 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:44.528977 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-846873fc-7ea2-43d2-8648-63a1723339fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:44.529582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-846873fc-7ea2-43d2-8648-63a1723339fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:44.537098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-846873fc-7ea2-43d2-8648-63a1723339fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:44.538383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-846873fc-7ea2-43d2-8648-63a1723339fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:44.539196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-846873fc-7ea2-43d2-8648-63a1723339fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:44.539656 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-846873fc-7ea2-43d2-8648-63a1723339fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:44.681519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-846873fc-7ea2-43d2-8648-63a1723339fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:44.690082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-846873fc-7ea2-43d2-8648-63a1723339fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:44.691628 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-846873fc-7ea2-43d2-8648-63a1723339fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:44.692732 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-846873fc-7ea2-43d2-8648-63a1723339fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.169538 Jul 04 05:58:44.693304 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 332/658] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:44 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:45.171027 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5e95360b-3cf9-48de-ba4b-c9715fd6cb8e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:45.171668 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5e95360b-3cf9-48de-ba4b-c9715fd6cb8e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:45.172374 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-32fc9aaf-bd35-432c-92e4-796381296f2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:45.172966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-32fc9aaf-bd35-432c-92e4-796381296f2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:45.178359 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e95360b-3cf9-48de-ba4b-c9715fd6cb8e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:45.178791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e95360b-3cf9-48de-ba4b-c9715fd6cb8e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:45.179647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e95360b-3cf9-48de-ba4b-c9715fd6cb8e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:45.179889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32fc9aaf-bd35-432c-92e4-796381296f2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:45.180060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e95360b-3cf9-48de-ba4b-c9715fd6cb8e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:45.180356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32fc9aaf-bd35-432c-92e4-796381296f2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:45.181137 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32fc9aaf-bd35-432c-92e4-796381296f2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:45.181570 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32fc9aaf-bd35-432c-92e4-796381296f2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:45.327872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-32fc9aaf-bd35-432c-92e4-796381296f2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:45.331187 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5e95360b-3cf9-48de-ba4b-c9715fd6cb8e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:45.336028 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-32fc9aaf-bd35-432c-92e4-796381296f2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.167817 Jul 04 05:58:45.336614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 333/659] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:45 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:45.338826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5e95360b-3cf9-48de-ba4b-c9715fd6cb8e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.172566 Jul 04 05:58:45.339410 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 327/660] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:45 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:45.715063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-de674dce-4300-4943-8a0e-462e68603e0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:45.715959 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-de674dce-4300-4943-8a0e-462e68603e0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:45.718837 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:45.728014 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de674dce-4300-4943-8a0e-462e68603e0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:45.728741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de674dce-4300-4943-8a0e-462e68603e0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:45.729987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de674dce-4300-4943-8a0e-462e68603e0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:45.730695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de674dce-4300-4943-8a0e-462e68603e0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:45.871485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-de674dce-4300-4943-8a0e-462e68603e0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:45.883008 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-de674dce-4300-4943-8a0e-462e68603e0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:45.885266 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-de674dce-4300-4943-8a0e-462e68603e0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:45.886895 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-de674dce-4300-4943-8a0e-462e68603e0a tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.178399 Jul 04 05:58:45.887748 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 334/661] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:45 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:46.355296 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5e21ffa2-8a49-451d-9fa6-7cccd625e03c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:46.355910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5e21ffa2-8a49-451d-9fa6-7cccd625e03c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:46.357170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fdc522d7-4af5-4454-8208-27eb8fa79007 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:46.357906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fdc522d7-4af5-4454-8208-27eb8fa79007 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:46.363449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e21ffa2-8a49-451d-9fa6-7cccd625e03c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:46.363970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e21ffa2-8a49-451d-9fa6-7cccd625e03c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:46.364865 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e21ffa2-8a49-451d-9fa6-7cccd625e03c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:46.365369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e21ffa2-8a49-451d-9fa6-7cccd625e03c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:46.365637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdc522d7-4af5-4454-8208-27eb8fa79007 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:46.366171 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdc522d7-4af5-4454-8208-27eb8fa79007 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:46.367053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdc522d7-4af5-4454-8208-27eb8fa79007 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:46.367641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdc522d7-4af5-4454-8208-27eb8fa79007 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:46.498947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5e21ffa2-8a49-451d-9fa6-7cccd625e03c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:46.500521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fdc522d7-4af5-4454-8208-27eb8fa79007 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:46.506808 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5e21ffa2-8a49-451d-9fa6-7cccd625e03c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.156271 Jul 04 05:58:46.507421 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 328/662] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:46 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:46.508441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fdc522d7-4af5-4454-8208-27eb8fa79007 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.155681 Jul 04 05:58:46.509011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 335/663] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:46 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:46.910103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-32d59e50-17d5-4e52-9ddc-8f7cdcaad807 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:46.911090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-32d59e50-17d5-4e52-9ddc-8f7cdcaad807 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:46.921664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32d59e50-17d5-4e52-9ddc-8f7cdcaad807 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:46.922412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32d59e50-17d5-4e52-9ddc-8f7cdcaad807 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:46.923740 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32d59e50-17d5-4e52-9ddc-8f7cdcaad807 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:46.924458 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32d59e50-17d5-4e52-9ddc-8f7cdcaad807 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:47.058427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32d59e50-17d5-4e52-9ddc-8f7cdcaad807 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:47.066596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32d59e50-17d5-4e52-9ddc-8f7cdcaad807 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:47.068121 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32d59e50-17d5-4e52-9ddc-8f7cdcaad807 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:47.069220 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-32d59e50-17d5-4e52-9ddc-8f7cdcaad807 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.166250 Jul 04 05:58:47.069785 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 329/664] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:46 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:47.524138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6191e478-26aa-4d07-9866-5b5fb7d96d0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:47.524808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6191e478-26aa-4d07-9866-5b5fb7d96d0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:47.525640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c3ca8552-c9fc-457a-8265-e35ee5c36f4e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:47.526248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c3ca8552-c9fc-457a-8265-e35ee5c36f4e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:47.531562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6191e478-26aa-4d07-9866-5b5fb7d96d0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:47.532015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6191e478-26aa-4d07-9866-5b5fb7d96d0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:47.532811 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6191e478-26aa-4d07-9866-5b5fb7d96d0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:47.533073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ca8552-c9fc-457a-8265-e35ee5c36f4e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:47.533241 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6191e478-26aa-4d07-9866-5b5fb7d96d0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:47.533525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ca8552-c9fc-457a-8265-e35ee5c36f4e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:47.534292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ca8552-c9fc-457a-8265-e35ee5c36f4e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:47.534733 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ca8552-c9fc-457a-8265-e35ee5c36f4e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:47.674369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3ca8552-c9fc-457a-8265-e35ee5c36f4e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:47.679228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6191e478-26aa-4d07-9866-5b5fb7d96d0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:47.682005 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c3ca8552-c9fc-457a-8265-e35ee5c36f4e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.160146 Jul 04 05:58:47.682557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 330/665] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:47 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:47.690356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6191e478-26aa-4d07-9866-5b5fb7d96d0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.170317 Jul 04 05:58:47.691093 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 336/666] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:47 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:48.091726 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8607fbc5-d647-40a1-bcc2-d15431e809d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:48.092719 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8607fbc5-d647-40a1-bcc2-d15431e809d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:48.103025 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8607fbc5-d647-40a1-bcc2-d15431e809d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:48.103822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8607fbc5-d647-40a1-bcc2-d15431e809d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:48.105051 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8607fbc5-d647-40a1-bcc2-d15431e809d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:48.105804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8607fbc5-d647-40a1-bcc2-d15431e809d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:48.248747 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8607fbc5-d647-40a1-bcc2-d15431e809d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:48.257105 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8607fbc5-d647-40a1-bcc2-d15431e809d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:48.258538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8607fbc5-d647-40a1-bcc2-d15431e809d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:48.259674 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8607fbc5-d647-40a1-bcc2-d15431e809d6 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.174615 Jul 04 05:58:48.260264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 331/667] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:48 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:48.702559 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0fb9a1d-5334-42ae-bed8-475bc703aaa2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:48.703133 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c0fb9a1d-5334-42ae-bed8-475bc703aaa2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:48.706554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-76d0ec77-e985-42da-825d-ed69a330d882 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:48.707168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-76d0ec77-e985-42da-825d-ed69a330d882 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:48.709841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0fb9a1d-5334-42ae-bed8-475bc703aaa2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:48.710293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0fb9a1d-5334-42ae-bed8-475bc703aaa2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:48.711059 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0fb9a1d-5334-42ae-bed8-475bc703aaa2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:48.711526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0fb9a1d-5334-42ae-bed8-475bc703aaa2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:48.714894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76d0ec77-e985-42da-825d-ed69a330d882 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:48.715391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76d0ec77-e985-42da-825d-ed69a330d882 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:48.716270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76d0ec77-e985-42da-825d-ed69a330d882 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:48.716674 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76d0ec77-e985-42da-825d-ed69a330d882 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:48.721301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:48.841283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c0fb9a1d-5334-42ae-bed8-475bc703aaa2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:48.848988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c0fb9a1d-5334-42ae-bed8-475bc703aaa2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.151612 Jul 04 05:58:48.849561 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 337/668] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:48 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:48.852024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-76d0ec77-e985-42da-825d-ed69a330d882 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:48.859834 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-76d0ec77-e985-42da-825d-ed69a330d882 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.157244 Jul 04 05:58:48.860420 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 332/669] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:48 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:49.280525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-81811afb-7649-4852-af2f-c5d83b8a2d04 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:49.281128 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-81811afb-7649-4852-af2f-c5d83b8a2d04 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:49.287509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81811afb-7649-4852-af2f-c5d83b8a2d04 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:49.287963 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81811afb-7649-4852-af2f-c5d83b8a2d04 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:49.288739 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81811afb-7649-4852-af2f-c5d83b8a2d04 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:49.289174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81811afb-7649-4852-af2f-c5d83b8a2d04 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:49.419969 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-81811afb-7649-4852-af2f-c5d83b8a2d04 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:49.432586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-81811afb-7649-4852-af2f-c5d83b8a2d04 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:49.434942 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-81811afb-7649-4852-af2f-c5d83b8a2d04 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:49.436081 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-81811afb-7649-4852-af2f-c5d83b8a2d04 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.161244 Jul 04 05:58:49.436644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 338/670] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:49 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:49.870368 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4eded026-509d-41c7-9564-9718c46f6bbe tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:49.871398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4eded026-509d-41c7-9564-9718c46f6bbe tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:49.877245 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-39526ec4-15db-4adc-9d3a-798c4151a313 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:49.877857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-39526ec4-15db-4adc-9d3a-798c4151a313 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:49.878616 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eded026-509d-41c7-9564-9718c46f6bbe tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:49.879074 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eded026-509d-41c7-9564-9718c46f6bbe tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:49.879878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eded026-509d-41c7-9564-9718c46f6bbe tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:49.880321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eded026-509d-41c7-9564-9718c46f6bbe tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:49.884278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39526ec4-15db-4adc-9d3a-798c4151a313 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:49.884731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39526ec4-15db-4adc-9d3a-798c4151a313 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:49.885501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39526ec4-15db-4adc-9d3a-798c4151a313 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:49.885939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39526ec4-15db-4adc-9d3a-798c4151a313 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:50.012526 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4eded026-509d-41c7-9564-9718c46f6bbe tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:50.019739 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-39526ec4-15db-4adc-9d3a-798c4151a313 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:50.020374 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4eded026-509d-41c7-9564-9718c46f6bbe tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.156706 Jul 04 05:58:50.020910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 333/671] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:49 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:50.027439 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-39526ec4-15db-4adc-9d3a-798c4151a313 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.153993 Jul 04 05:58:50.028066 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 339/672] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:49 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:50.457442 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-58fa9d3c-4cdb-4da6-bc87-e8836523efc7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:50.458470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-58fa9d3c-4cdb-4da6-bc87-e8836523efc7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:50.469339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58fa9d3c-4cdb-4da6-bc87-e8836523efc7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:50.470078 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58fa9d3c-4cdb-4da6-bc87-e8836523efc7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:50.471320 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58fa9d3c-4cdb-4da6-bc87-e8836523efc7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:50.472089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58fa9d3c-4cdb-4da6-bc87-e8836523efc7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:50.608449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-58fa9d3c-4cdb-4da6-bc87-e8836523efc7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:50.621134 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-58fa9d3c-4cdb-4da6-bc87-e8836523efc7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:50.622939 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-58fa9d3c-4cdb-4da6-bc87-e8836523efc7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:50.624094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-58fa9d3c-4cdb-4da6-bc87-e8836523efc7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.173268 Jul 04 05:58:50.624645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 334/673] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:50 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:51.043669 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9374d060-60b0-440c-bf1c-e986f3c77fce tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:51.044527 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9374d060-60b0-440c-bf1c-e986f3c77fce tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:51.047162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73a52ee8-31cb-4326-ba6d-b89dec43301e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:51.047798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73a52ee8-31cb-4326-ba6d-b89dec43301e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:51.051571 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9374d060-60b0-440c-bf1c-e986f3c77fce tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:51.052024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9374d060-60b0-440c-bf1c-e986f3c77fce tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:51.052804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9374d060-60b0-440c-bf1c-e986f3c77fce tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:51.053241 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9374d060-60b0-440c-bf1c-e986f3c77fce tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:51.054495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73a52ee8-31cb-4326-ba6d-b89dec43301e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:51.054948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73a52ee8-31cb-4326-ba6d-b89dec43301e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:51.055736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73a52ee8-31cb-4326-ba6d-b89dec43301e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:51.056167 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73a52ee8-31cb-4326-ba6d-b89dec43301e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:51.182991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9374d060-60b0-440c-bf1c-e986f3c77fce tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:51.185932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73a52ee8-31cb-4326-ba6d-b89dec43301e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:51.190789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9374d060-60b0-440c-bf1c-e986f3c77fce tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.154791 Jul 04 05:58:51.191478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 340/674] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:51 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:51.193430 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73a52ee8-31cb-4326-ba6d-b89dec43301e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.151009 Jul 04 05:58:51.193984 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 335/675] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:51 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:51.645916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e884753d-c0c6-47be-8ef6-712053c0aaf4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:51.646763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e884753d-c0c6-47be-8ef6-712053c0aaf4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:51.655838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e884753d-c0c6-47be-8ef6-712053c0aaf4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:51.656288 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e884753d-c0c6-47be-8ef6-712053c0aaf4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:51.657032 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e884753d-c0c6-47be-8ef6-712053c0aaf4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:51.657456 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e884753d-c0c6-47be-8ef6-712053c0aaf4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:51.799725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e884753d-c0c6-47be-8ef6-712053c0aaf4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:51.807768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e884753d-c0c6-47be-8ef6-712053c0aaf4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:51.809244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e884753d-c0c6-47be-8ef6-712053c0aaf4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:51.810357 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e884753d-c0c6-47be-8ef6-712053c0aaf4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.171038 Jul 04 05:58:51.810919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 341/676] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:51 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:52.213971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-86450788-9dfc-47e9-9255-fea133d25ead tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:52.213971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-86450788-9dfc-47e9-9255-fea133d25ead tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:52.215119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-84d9ecc3-093b-44a0-8c5f-a9b741dd712f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:52.215119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-84d9ecc3-093b-44a0-8c5f-a9b741dd712f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:52.218203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:52.222112 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86450788-9dfc-47e9-9255-fea133d25ead tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:52.222579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86450788-9dfc-47e9-9255-fea133d25ead tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:52.222782 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84d9ecc3-093b-44a0-8c5f-a9b741dd712f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:52.223265 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84d9ecc3-093b-44a0-8c5f-a9b741dd712f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:52.223472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86450788-9dfc-47e9-9255-fea133d25ead tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:52.223887 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86450788-9dfc-47e9-9255-fea133d25ead tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:52.224082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84d9ecc3-093b-44a0-8c5f-a9b741dd712f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:52.224455 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84d9ecc3-093b-44a0-8c5f-a9b741dd712f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:52.356090 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-84d9ecc3-093b-44a0-8c5f-a9b741dd712f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:52.362276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-86450788-9dfc-47e9-9255-fea133d25ead tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:52.366205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-84d9ecc3-093b-44a0-8c5f-a9b741dd712f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.158743 Jul 04 05:58:52.366789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 342/677] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:52 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:52.373129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-86450788-9dfc-47e9-9255-fea133d25ead tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.167119 Jul 04 05:58:52.373669 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 336/678] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:52 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:52.832750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6d676a84-0eba-4bff-92a4-78b36723c12f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:52.833757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6d676a84-0eba-4bff-92a4-78b36723c12f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:52.843088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d676a84-0eba-4bff-92a4-78b36723c12f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:52.843568 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d676a84-0eba-4bff-92a4-78b36723c12f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:52.844335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d676a84-0eba-4bff-92a4-78b36723c12f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:52.844771 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d676a84-0eba-4bff-92a4-78b36723c12f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:52.982463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6d676a84-0eba-4bff-92a4-78b36723c12f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:52.990554 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6d676a84-0eba-4bff-92a4-78b36723c12f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:52.992095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6d676a84-0eba-4bff-92a4-78b36723c12f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:52.993203 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6d676a84-0eba-4bff-92a4-78b36723c12f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.167165 Jul 04 05:58:52.993806 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 343/679] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:52 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:53.386542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-142e6ee3-be2a-416c-9d60-d5d91c6e74fb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:53.387225 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-142e6ee3-be2a-416c-9d60-d5d91c6e74fb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:53.390615 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3f62a18e-bea0-48bc-a581-700ad1fc82b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:53.391212 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3f62a18e-bea0-48bc-a581-700ad1fc82b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:53.394551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-142e6ee3-be2a-416c-9d60-d5d91c6e74fb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:53.395000 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-142e6ee3-be2a-416c-9d60-d5d91c6e74fb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:53.395816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-142e6ee3-be2a-416c-9d60-d5d91c6e74fb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:53.396257 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-142e6ee3-be2a-416c-9d60-d5d91c6e74fb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:53.397918 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f62a18e-bea0-48bc-a581-700ad1fc82b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:53.398361 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f62a18e-bea0-48bc-a581-700ad1fc82b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:53.399112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f62a18e-bea0-48bc-a581-700ad1fc82b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:53.399569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f62a18e-bea0-48bc-a581-700ad1fc82b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:53.534934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3f62a18e-bea0-48bc-a581-700ad1fc82b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:53.543236 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3f62a18e-bea0-48bc-a581-700ad1fc82b5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.156720 Jul 04 05:58:53.544034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 344/680] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:53 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:53.545070 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-142e6ee3-be2a-416c-9d60-d5d91c6e74fb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:53.553149 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-142e6ee3-be2a-416c-9d60-d5d91c6e74fb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.171271 Jul 04 05:58:53.553793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 337/681] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:53 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:54.014714 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4863cf9-1909-45b0-b266-90df4c71468b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:54.015311 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f4863cf9-1909-45b0-b266-90df4c71468b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:54.023222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4863cf9-1909-45b0-b266-90df4c71468b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:54.023701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4863cf9-1909-45b0-b266-90df4c71468b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:54.024444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4863cf9-1909-45b0-b266-90df4c71468b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:54.024893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4863cf9-1909-45b0-b266-90df4c71468b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:54.153302 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f4863cf9-1909-45b0-b266-90df4c71468b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:54.161620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f4863cf9-1909-45b0-b266-90df4c71468b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:54.163081 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f4863cf9-1909-45b0-b266-90df4c71468b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:54.164205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f4863cf9-1909-45b0-b266-90df4c71468b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.155073 Jul 04 05:58:54.164754 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 345/682] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:54 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:54.562514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1093fb7b-c5ce-4257-88d1-ff56fc834d28 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:54.563113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1093fb7b-c5ce-4257-88d1-ff56fc834d28 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:54.569820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d9e45056-6c2a-4812-ad4e-44b09f9ec8e2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:54.570306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1093fb7b-c5ce-4257-88d1-ff56fc834d28 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:54.570418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d9e45056-6c2a-4812-ad4e-44b09f9ec8e2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:54.570600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1093fb7b-c5ce-4257-88d1-ff56fc834d28 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:54.571382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1093fb7b-c5ce-4257-88d1-ff56fc834d28 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:54.571810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1093fb7b-c5ce-4257-88d1-ff56fc834d28 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:54.578586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9e45056-6c2a-4812-ad4e-44b09f9ec8e2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:54.579042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9e45056-6c2a-4812-ad4e-44b09f9ec8e2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:54.579854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9e45056-6c2a-4812-ad4e-44b09f9ec8e2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:54.580288 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9e45056-6c2a-4812-ad4e-44b09f9ec8e2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:54.599015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:54.709076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1093fb7b-c5ce-4257-88d1-ff56fc834d28 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:54.718150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1093fb7b-c5ce-4257-88d1-ff56fc834d28 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.160799 Jul 04 05:58:54.718725 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 338/683] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:54 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:54.842271 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9e45056-6c2a-4812-ad4e-44b09f9ec8e2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:54.854075 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d9e45056-6c2a-4812-ad4e-44b09f9ec8e2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.287764 Jul 04 05:58:54.854758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 346/684] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:54 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:55.187603 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0703f0c4-3971-4b7b-9ac5-42804cb9c517 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:55.188349 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0703f0c4-3971-4b7b-9ac5-42804cb9c517 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:55.196241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0703f0c4-3971-4b7b-9ac5-42804cb9c517 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:55.196884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0703f0c4-3971-4b7b-9ac5-42804cb9c517 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:55.197801 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0703f0c4-3971-4b7b-9ac5-42804cb9c517 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:55.198345 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0703f0c4-3971-4b7b-9ac5-42804cb9c517 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:55.405327 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0703f0c4-3971-4b7b-9ac5-42804cb9c517 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:55.413428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0703f0c4-3971-4b7b-9ac5-42804cb9c517 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:55.414900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0703f0c4-3971-4b7b-9ac5-42804cb9c517 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:55.416391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0703f0c4-3971-4b7b-9ac5-42804cb9c517 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.234774 Jul 04 05:58:55.416961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 339/685] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:55 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:55.735985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e4607fc4-9255-4ed1-b060-bce293ebbc69 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:55.736626 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e4607fc4-9255-4ed1-b060-bce293ebbc69 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:55.743349 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4607fc4-9255-4ed1-b060-bce293ebbc69 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:55.744026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4607fc4-9255-4ed1-b060-bce293ebbc69 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:55.744818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4607fc4-9255-4ed1-b060-bce293ebbc69 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:55.745461 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4607fc4-9255-4ed1-b060-bce293ebbc69 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:55.872644 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e4debb06-5fca-4dcb-a347-5e1c35d26dd9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:55.873248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e4debb06-5fca-4dcb-a347-5e1c35d26dd9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:55.877184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e4607fc4-9255-4ed1-b060-bce293ebbc69 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:55.879961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4debb06-5fca-4dcb-a347-5e1c35d26dd9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:55.880756 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4debb06-5fca-4dcb-a347-5e1c35d26dd9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:55.881311 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4debb06-5fca-4dcb-a347-5e1c35d26dd9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:55.881750 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4debb06-5fca-4dcb-a347-5e1c35d26dd9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:55.884982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e4607fc4-9255-4ed1-b060-bce293ebbc69 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.152787 Jul 04 05:58:55.886841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 347/686] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:55 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:56.011602 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e4debb06-5fca-4dcb-a347-5e1c35d26dd9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:56.021268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e4debb06-5fca-4dcb-a347-5e1c35d26dd9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.152504 Jul 04 05:58:56.022061 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 340/687] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:55 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:56.444357 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cd2097b3-b0ad-4b0a-8345-a2c7aa7962e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:56.445194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cd2097b3-b0ad-4b0a-8345-a2c7aa7962e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:56.454586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd2097b3-b0ad-4b0a-8345-a2c7aa7962e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:56.455089 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd2097b3-b0ad-4b0a-8345-a2c7aa7962e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:56.455971 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd2097b3-b0ad-4b0a-8345-a2c7aa7962e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:56.456457 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd2097b3-b0ad-4b0a-8345-a2c7aa7962e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:56.601844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cd2097b3-b0ad-4b0a-8345-a2c7aa7962e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:56.610367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cd2097b3-b0ad-4b0a-8345-a2c7aa7962e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:56.611897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cd2097b3-b0ad-4b0a-8345-a2c7aa7962e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:56.613031 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cd2097b3-b0ad-4b0a-8345-a2c7aa7962e2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.180559 Jul 04 05:58:56.613569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 348/688] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:56 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:56.904492 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-802e370a-1821-4181-a279-37e552aa2175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:56.905317 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-802e370a-1821-4181-a279-37e552aa2175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:56.914291 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-802e370a-1821-4181-a279-37e552aa2175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:56.914900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-802e370a-1821-4181-a279-37e552aa2175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:56.916354 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-802e370a-1821-4181-a279-37e552aa2175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:56.916941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-802e370a-1821-4181-a279-37e552aa2175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:57.045174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ee71f78a-44e8-4bfa-a5cc-b62f7c626a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:57.045783 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ee71f78a-44e8-4bfa-a5cc-b62f7c626a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:57.052562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee71f78a-44e8-4bfa-a5cc-b62f7c626a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:57.053012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee71f78a-44e8-4bfa-a5cc-b62f7c626a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:57.053772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee71f78a-44e8-4bfa-a5cc-b62f7c626a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:57.054169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee71f78a-44e8-4bfa-a5cc-b62f7c626a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:57.056115 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-802e370a-1821-4181-a279-37e552aa2175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:57.064622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-802e370a-1821-4181-a279-37e552aa2175 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.165333 Jul 04 05:58:57.065205 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 341/689] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:56 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:57.194711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ee71f78a-44e8-4bfa-a5cc-b62f7c626a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:57.202703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ee71f78a-44e8-4bfa-a5cc-b62f7c626a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.162118 Jul 04 05:58:57.203278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 349/690] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:57 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:57.633568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0901fb1f-0119-4181-842f-8b38890fb73e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:57.634464 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0901fb1f-0119-4181-842f-8b38890fb73e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:57.643759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0901fb1f-0119-4181-842f-8b38890fb73e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:57.644392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0901fb1f-0119-4181-842f-8b38890fb73e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:57.645467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0901fb1f-0119-4181-842f-8b38890fb73e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:57.646078 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0901fb1f-0119-4181-842f-8b38890fb73e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:57.781796 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0901fb1f-0119-4181-842f-8b38890fb73e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:57.791106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0901fb1f-0119-4181-842f-8b38890fb73e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:57.792606 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0901fb1f-0119-4181-842f-8b38890fb73e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:57.793698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0901fb1f-0119-4181-842f-8b38890fb73e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.165704 Jul 04 05:58:57.794470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 342/691] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:57 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:58.082370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-55c4f7f6-8108-4a96-bcd4-d8a6219973e4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:58.082917 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-55c4f7f6-8108-4a96-bcd4-d8a6219973e4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:58.090577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55c4f7f6-8108-4a96-bcd4-d8a6219973e4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:58.091169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55c4f7f6-8108-4a96-bcd4-d8a6219973e4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:58.091991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55c4f7f6-8108-4a96-bcd4-d8a6219973e4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:58.092426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55c4f7f6-8108-4a96-bcd4-d8a6219973e4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:58.219569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-03758b54-68e1-44be-9640-ad978652d997 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:58.220188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-03758b54-68e1-44be-9640-ad978652d997 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:58.226779 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03758b54-68e1-44be-9640-ad978652d997 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:58.227221 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03758b54-68e1-44be-9640-ad978652d997 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:58.228013 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03758b54-68e1-44be-9640-ad978652d997 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:58.228437 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03758b54-68e1-44be-9640-ad978652d997 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:58.235583 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-55c4f7f6-8108-4a96-bcd4-d8a6219973e4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:58.243069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-55c4f7f6-8108-4a96-bcd4-d8a6219973e4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.165104 Jul 04 05:58:58.243979 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 350/692] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:58 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:58.358820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-03758b54-68e1-44be-9640-ad978652d997 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:58.366489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-03758b54-68e1-44be-9640-ad978652d997 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.150868 Jul 04 05:58:58.367063 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 343/693] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:58 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:58:58.813947 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c11b1c70-764c-4a0e-916a-32c7ec0d4562 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:58.814623 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c11b1c70-764c-4a0e-916a-32c7ec0d4562 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:58.821153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c11b1c70-764c-4a0e-916a-32c7ec0d4562 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:58.821635 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c11b1c70-764c-4a0e-916a-32c7ec0d4562 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:58.822565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c11b1c70-764c-4a0e-916a-32c7ec0d4562 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:58.822820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c11b1c70-764c-4a0e-916a-32c7ec0d4562 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:58.959096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c11b1c70-764c-4a0e-916a-32c7ec0d4562 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:58.967731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c11b1c70-764c-4a0e-916a-32c7ec0d4562 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:58.969216 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c11b1c70-764c-4a0e-916a-32c7ec0d4562 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:58.970309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c11b1c70-764c-4a0e-916a-32c7ec0d4562 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.160955 Jul 04 05:58:58.970878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 351/694] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:58 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:58:59.264822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a7aacc10-70df-4e94-99ae-874a72cb47f9 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:59.265936 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a7aacc10-70df-4e94-99ae-874a72cb47f9 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:59.276892 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7aacc10-70df-4e94-99ae-874a72cb47f9 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:59.277638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7aacc10-70df-4e94-99ae-874a72cb47f9 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:59.278893 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7aacc10-70df-4e94-99ae-874a72cb47f9 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:59.279671 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7aacc10-70df-4e94-99ae-874a72cb47f9 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:59.387500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-de4b20c2-ec1d-4648-ab47-836c2ff72ba9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:59.388422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-de4b20c2-ec1d-4648-ab47-836c2ff72ba9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:59.395414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de4b20c2-ec1d-4648-ab47-836c2ff72ba9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:59.395867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de4b20c2-ec1d-4648-ab47-836c2ff72ba9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:59.396651 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de4b20c2-ec1d-4648-ab47-836c2ff72ba9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:59.397060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de4b20c2-ec1d-4648-ab47-836c2ff72ba9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:59.539886 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-de4b20c2-ec1d-4648-ab47-836c2ff72ba9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:59.548825 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-de4b20c2-ec1d-4648-ab47-836c2ff72ba9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.167660 Jul 04 05:58:59.549438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 352/695] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:59 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:59.652974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a7aacc10-70df-4e94-99ae-874a72cb47f9 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:58:59.660815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a7aacc10-70df-4e94-99ae-874a72cb47f9 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.402788 Jul 04 05:58:59.661403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 344/696] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:58:59 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:58:59.683290 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b68d5b80-ab0a-4ca8-ac57-6a4464facb42 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:59.683827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b68d5b80-ab0a-4ca8-ac57-6a4464facb42 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:59.692104 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b68d5b80-ab0a-4ca8-ac57-6a4464facb42 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:59.692551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b68d5b80-ab0a-4ca8-ac57-6a4464facb42 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:59.695125 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b68d5b80-ab0a-4ca8-ac57-6a4464facb42 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:59.695125 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b68d5b80-ab0a-4ca8-ac57-6a4464facb42 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:59.718251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b68d5b80-ab0a-4ca8-ac57-6a4464facb42 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162/ips" status: 200 len: 148 microversion: 2.1 time: 0.038814 Jul 04 05:58:59.718821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 353/697] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jul 4 05:58:59 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:58:59.989037 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b33e1d0c-515e-4614-b249-478ce6ed34fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:58:59.989675 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b33e1d0c-515e-4614-b249-478ce6ed34fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:58:59.998566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b33e1d0c-515e-4614-b249-478ce6ed34fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:58:59.999017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b33e1d0c-515e-4614-b249-478ce6ed34fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:58:59.999838 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b33e1d0c-515e-4614-b249-478ce6ed34fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:00.000306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b33e1d0c-515e-4614-b249-478ce6ed34fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:00.130824 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b33e1d0c-515e-4614-b249-478ce6ed34fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:00.139272 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b33e1d0c-515e-4614-b249-478ce6ed34fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:00.140784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b33e1d0c-515e-4614-b249-478ce6ed34fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:00.141890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b33e1d0c-515e-4614-b249-478ce6ed34fd tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.157166 Jul 04 05:59:00.142489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 345/698] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:58:59 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:00.568548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9ab99257-11e8-4563-a95e-2c7f914585cc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:00.569407 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9ab99257-11e8-4563-a95e-2c7f914585cc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:00.579133 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ab99257-11e8-4563-a95e-2c7f914585cc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:00.579821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ab99257-11e8-4563-a95e-2c7f914585cc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:00.580907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ab99257-11e8-4563-a95e-2c7f914585cc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:00.581525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ab99257-11e8-4563-a95e-2c7f914585cc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:00.678145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f60e4dbc-a294-49ff-a1a4-474fdf9c3a0e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:00.678766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f60e4dbc-a294-49ff-a1a4-474fdf9c3a0e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:00.685600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f60e4dbc-a294-49ff-a1a4-474fdf9c3a0e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:00.686056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f60e4dbc-a294-49ff-a1a4-474fdf9c3a0e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:00.686837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f60e4dbc-a294-49ff-a1a4-474fdf9c3a0e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:00.687299 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f60e4dbc-a294-49ff-a1a4-474fdf9c3a0e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:00.727619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9ab99257-11e8-4563-a95e-2c7f914585cc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:00.736903 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9ab99257-11e8-4563-a95e-2c7f914585cc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.173904 Jul 04 05:59:00.737487 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 354/699] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:00 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:00.819566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f60e4dbc-a294-49ff-a1a4-474fdf9c3a0e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:00.827448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f60e4dbc-a294-49ff-a1a4-474fdf9c3a0e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.153156 Jul 04 05:59:00.828019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 346/700] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:00 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:01.164293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9acd3dbb-2ae5-44e9-bde9-827a49d8a60f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:01.165673 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9acd3dbb-2ae5-44e9-bde9-827a49d8a60f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:01.176300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9acd3dbb-2ae5-44e9-bde9-827a49d8a60f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:01.177048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9acd3dbb-2ae5-44e9-bde9-827a49d8a60f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:01.178301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9acd3dbb-2ae5-44e9-bde9-827a49d8a60f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:01.179016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9acd3dbb-2ae5-44e9-bde9-827a49d8a60f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:01.323415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9acd3dbb-2ae5-44e9-bde9-827a49d8a60f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:01.335465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9acd3dbb-2ae5-44e9-bde9-827a49d8a60f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:01.337891 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9acd3dbb-2ae5-44e9-bde9-827a49d8a60f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:01.339722 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9acd3dbb-2ae5-44e9-bde9-827a49d8a60f tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.181729 Jul 04 05:59:01.340539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 355/701] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:01 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:01.754974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9260a18c-2b75-4829-847e-147236be14b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:01.755648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9260a18c-2b75-4829-847e-147236be14b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:01.762559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9260a18c-2b75-4829-847e-147236be14b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:01.763065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9260a18c-2b75-4829-847e-147236be14b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:01.763858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9260a18c-2b75-4829-847e-147236be14b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:01.764293 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9260a18c-2b75-4829-847e-147236be14b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:01.845200 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3c178f52-825c-484b-a45b-47f31dee47b2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:01.845779 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3c178f52-825c-484b-a45b-47f31dee47b2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:01.852549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c178f52-825c-484b-a45b-47f31dee47b2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:01.852962 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c178f52-825c-484b-a45b-47f31dee47b2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:01.853955 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c178f52-825c-484b-a45b-47f31dee47b2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:01.854393 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c178f52-825c-484b-a45b-47f31dee47b2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:01.902756 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9260a18c-2b75-4829-847e-147236be14b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:01.911402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9260a18c-2b75-4829-847e-147236be14b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.160483 Jul 04 05:59:01.912112 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 347/702] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:01 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:01.986017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3c178f52-825c-484b-a45b-47f31dee47b2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:01.994155 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3c178f52-825c-484b-a45b-47f31dee47b2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.152969 Jul 04 05:59:01.994720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 356/703] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:01 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:02.359346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad3f7e95-c97b-4397-9d76-d62b5c435376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:02.360355 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ad3f7e95-c97b-4397-9d76-d62b5c435376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:02.369655 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad3f7e95-c97b-4397-9d76-d62b5c435376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:02.370328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad3f7e95-c97b-4397-9d76-d62b5c435376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:02.371529 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad3f7e95-c97b-4397-9d76-d62b5c435376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:02.372204 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad3f7e95-c97b-4397-9d76-d62b5c435376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:02.510425 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad3f7e95-c97b-4397-9d76-d62b5c435376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:02.514666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:02.520046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad3f7e95-c97b-4397-9d76-d62b5c435376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:02.521552 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad3f7e95-c97b-4397-9d76-d62b5c435376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:02.522679 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ad3f7e95-c97b-4397-9d76-d62b5c435376 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.167784 Jul 04 05:59:02.523259 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 348/704] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:02 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:02.935178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8b5ed9db-c7ca-431b-b016-27fadc89a48a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:02.936222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8b5ed9db-c7ca-431b-b016-27fadc89a48a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:02.946534 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b5ed9db-c7ca-431b-b016-27fadc89a48a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:02.947286 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b5ed9db-c7ca-431b-b016-27fadc89a48a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:02.948471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b5ed9db-c7ca-431b-b016-27fadc89a48a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:02.949178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b5ed9db-c7ca-431b-b016-27fadc89a48a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:03.011816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ddbff68b-6188-4fcc-a2fb-10c4301531bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:03.012425 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ddbff68b-6188-4fcc-a2fb-10c4301531bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:03.019225 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddbff68b-6188-4fcc-a2fb-10c4301531bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:03.019689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddbff68b-6188-4fcc-a2fb-10c4301531bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:03.020449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddbff68b-6188-4fcc-a2fb-10c4301531bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:03.020882 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddbff68b-6188-4fcc-a2fb-10c4301531bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:03.086627 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8b5ed9db-c7ca-431b-b016-27fadc89a48a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:03.105069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8b5ed9db-c7ca-431b-b016-27fadc89a48a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.177672 Jul 04 05:59:03.107846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 357/705] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:02 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:03.159443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ddbff68b-6188-4fcc-a2fb-10c4301531bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:03.167233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ddbff68b-6188-4fcc-a2fb-10c4301531bf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.159367 Jul 04 05:59:03.167928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 349/706] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:03 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:03.541429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e2b2e2f8-9a1f-4b9c-8080-f0d528315edf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:03.542036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e2b2e2f8-9a1f-4b9c-8080-f0d528315edf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:03.548471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2b2e2f8-9a1f-4b9c-8080-f0d528315edf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:03.548919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2b2e2f8-9a1f-4b9c-8080-f0d528315edf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:03.549688 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2b2e2f8-9a1f-4b9c-8080-f0d528315edf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:03.550148 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2b2e2f8-9a1f-4b9c-8080-f0d528315edf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:03.683812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e2b2e2f8-9a1f-4b9c-8080-f0d528315edf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:03.696320 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e2b2e2f8-9a1f-4b9c-8080-f0d528315edf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:03.698539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e2b2e2f8-9a1f-4b9c-8080-f0d528315edf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:03.700386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e2b2e2f8-9a1f-4b9c-8080-f0d528315edf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.162964 Jul 04 05:59:03.700952 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 358/707] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:03 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:04.123753 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eaa219fd-8647-42cf-b75e-a33fec17565c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:04.124395 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eaa219fd-8647-42cf-b75e-a33fec17565c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:04.131446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eaa219fd-8647-42cf-b75e-a33fec17565c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:04.131895 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eaa219fd-8647-42cf-b75e-a33fec17565c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:04.132670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eaa219fd-8647-42cf-b75e-a33fec17565c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:04.133106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eaa219fd-8647-42cf-b75e-a33fec17565c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:04.185026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e62cc02f-9fb4-4c3b-9f85-acca62265ade tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:04.185696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e62cc02f-9fb4-4c3b-9f85-acca62265ade tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:04.193393 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e62cc02f-9fb4-4c3b-9f85-acca62265ade tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:04.193992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e62cc02f-9fb4-4c3b-9f85-acca62265ade tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:04.194822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e62cc02f-9fb4-4c3b-9f85-acca62265ade tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:04.195337 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e62cc02f-9fb4-4c3b-9f85-acca62265ade tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:04.268159 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eaa219fd-8647-42cf-b75e-a33fec17565c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:04.275891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eaa219fd-8647-42cf-b75e-a33fec17565c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.156089 Jul 04 05:59:04.276488 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 350/708] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:04 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:04.330650 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e62cc02f-9fb4-4c3b-9f85-acca62265ade tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:04.338355 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e62cc02f-9fb4-4c3b-9f85-acca62265ade tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.157289 Jul 04 05:59:04.339063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 359/709] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:04 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:04.779639 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1be18b8-66f5-4a1f-9aeb-7207c50a3e67 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:04.780339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a1be18b8-66f5-4a1f-9aeb-7207c50a3e67 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:04.787052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1be18b8-66f5-4a1f-9aeb-7207c50a3e67 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:04.787540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1be18b8-66f5-4a1f-9aeb-7207c50a3e67 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:04.788286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1be18b8-66f5-4a1f-9aeb-7207c50a3e67 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:04.788723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1be18b8-66f5-4a1f-9aeb-7207c50a3e67 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:04.930857 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a1be18b8-66f5-4a1f-9aeb-7207c50a3e67 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:04.942981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a1be18b8-66f5-4a1f-9aeb-7207c50a3e67 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:04.945295 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a1be18b8-66f5-4a1f-9aeb-7207c50a3e67 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:04.946913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a1be18b8-66f5-4a1f-9aeb-7207c50a3e67 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.230825 Jul 04 05:59:04.947754 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 351/710] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:04 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:05.293077 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3d23587d-03fe-44dc-9fa3-c8f525593e3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:05.293580 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3d23587d-03fe-44dc-9fa3-c8f525593e3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:05.300510 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d23587d-03fe-44dc-9fa3-c8f525593e3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:05.300955 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d23587d-03fe-44dc-9fa3-c8f525593e3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:05.301742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d23587d-03fe-44dc-9fa3-c8f525593e3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:05.302179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d23587d-03fe-44dc-9fa3-c8f525593e3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:05.355794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6032b4d-b824-4f75-85b7-0ed9d37c1dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:05.356492 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e6032b4d-b824-4f75-85b7-0ed9d37c1dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:05.363270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6032b4d-b824-4f75-85b7-0ed9d37c1dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:05.363827 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6032b4d-b824-4f75-85b7-0ed9d37c1dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:05.364693 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6032b4d-b824-4f75-85b7-0ed9d37c1dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:05.365136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6032b4d-b824-4f75-85b7-0ed9d37c1dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:05.435184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3d23587d-03fe-44dc-9fa3-c8f525593e3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:05.442988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3d23587d-03fe-44dc-9fa3-c8f525593e3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.154200 Jul 04 05:59:05.443656 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 360/711] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:05 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:05.498253 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6032b4d-b824-4f75-85b7-0ed9d37c1dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:05.505960 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e6032b4d-b824-4f75-85b7-0ed9d37c1dfc tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.154472 Jul 04 05:59:05.506580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 352/712] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:05 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:05.969096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-14ebdc56-89b8-42f2-9edb-f517728ec5e8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:05.969853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-14ebdc56-89b8-42f2-9edb-f517728ec5e8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:05.977899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14ebdc56-89b8-42f2-9edb-f517728ec5e8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:05.978462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14ebdc56-89b8-42f2-9edb-f517728ec5e8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:05.979462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14ebdc56-89b8-42f2-9edb-f517728ec5e8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:05.980006 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14ebdc56-89b8-42f2-9edb-f517728ec5e8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:06.116864 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-14ebdc56-89b8-42f2-9edb-f517728ec5e8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:06.125221 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-14ebdc56-89b8-42f2-9edb-f517728ec5e8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:06.127402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-14ebdc56-89b8-42f2-9edb-f517728ec5e8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:06.129329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-14ebdc56-89b8-42f2-9edb-f517728ec5e8 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.165749 Jul 04 05:59:06.129941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 361/713] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:05 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:06.462927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5c5c154f-0aee-49c0-95b5-d84a7b6aaa53 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:06.463944 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5c5c154f-0aee-49c0-95b5-d84a7b6aaa53 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:06.474812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c5c154f-0aee-49c0-95b5-d84a7b6aaa53 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:06.475602 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c5c154f-0aee-49c0-95b5-d84a7b6aaa53 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:06.476805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c5c154f-0aee-49c0-95b5-d84a7b6aaa53 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:06.477473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c5c154f-0aee-49c0-95b5-d84a7b6aaa53 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:06.523213 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5a786f9f-409a-4e5e-8e88-dcbdcd3cd0db tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:06.523853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5a786f9f-409a-4e5e-8e88-dcbdcd3cd0db tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:06.530419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a786f9f-409a-4e5e-8e88-dcbdcd3cd0db tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:06.530873 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a786f9f-409a-4e5e-8e88-dcbdcd3cd0db tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:06.531678 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a786f9f-409a-4e5e-8e88-dcbdcd3cd0db tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:06.532297 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a786f9f-409a-4e5e-8e88-dcbdcd3cd0db tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:06.615443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5c5c154f-0aee-49c0-95b5-d84a7b6aaa53 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:06.623064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5c5c154f-0aee-49c0-95b5-d84a7b6aaa53 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.166436 Jul 04 05:59:06.623843 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 353/714] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:06 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:06.662618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5a786f9f-409a-4e5e-8e88-dcbdcd3cd0db tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:06.674468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5a786f9f-409a-4e5e-8e88-dcbdcd3cd0db tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.154810 Jul 04 05:59:06.675321 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 362/715] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:06 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:07.151329 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-383664bc-8b99-493b-9748-bbb4e83bc7c2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:07.152379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-383664bc-8b99-493b-9748-bbb4e83bc7c2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:07.162648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-383664bc-8b99-493b-9748-bbb4e83bc7c2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:07.163503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-383664bc-8b99-493b-9748-bbb4e83bc7c2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:07.164729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-383664bc-8b99-493b-9748-bbb4e83bc7c2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:07.165829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-383664bc-8b99-493b-9748-bbb4e83bc7c2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:07.308634 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-383664bc-8b99-493b-9748-bbb4e83bc7c2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:07.317230 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-383664bc-8b99-493b-9748-bbb4e83bc7c2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:07.318786 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-383664bc-8b99-493b-9748-bbb4e83bc7c2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:07.319892 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-383664bc-8b99-493b-9748-bbb4e83bc7c2 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.175057 Jul 04 05:59:07.320454 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 354/716] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:07 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:07.643722 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7b03f582-9377-4f41-a5cf-ae20d128a764 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:07.644493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7b03f582-9377-4f41-a5cf-ae20d128a764 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:07.654766 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b03f582-9377-4f41-a5cf-ae20d128a764 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:07.655210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b03f582-9377-4f41-a5cf-ae20d128a764 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:07.656009 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b03f582-9377-4f41-a5cf-ae20d128a764 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:07.656448 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b03f582-9377-4f41-a5cf-ae20d128a764 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:07.678381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:07.692377 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fc683bb2-c486-4752-a857-338fcd90d87c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:07.692965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fc683bb2-c486-4752-a857-338fcd90d87c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:07.700014 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc683bb2-c486-4752-a857-338fcd90d87c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:07.700464 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc683bb2-c486-4752-a857-338fcd90d87c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:07.701236 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc683bb2-c486-4752-a857-338fcd90d87c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:07.701673 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc683bb2-c486-4752-a857-338fcd90d87c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:07.794088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b03f582-9377-4f41-a5cf-ae20d128a764 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:07.802787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7b03f582-9377-4f41-a5cf-ae20d128a764 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.165082 Jul 04 05:59:07.803431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 363/717] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:07 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:07.835562 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fc683bb2-c486-4752-a857-338fcd90d87c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:07.845605 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fc683bb2-c486-4752-a857-338fcd90d87c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.156928 Jul 04 05:59:07.846384 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 355/718] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:07 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:08.343145 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5142a5d6-b3a7-4b93-9f04-cc215f3dc2af tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:08.343692 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5142a5d6-b3a7-4b93-9f04-cc215f3dc2af tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:08.350118 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5142a5d6-b3a7-4b93-9f04-cc215f3dc2af tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:08.350560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5142a5d6-b3a7-4b93-9f04-cc215f3dc2af tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:08.351344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5142a5d6-b3a7-4b93-9f04-cc215f3dc2af tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:08.351772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5142a5d6-b3a7-4b93-9f04-cc215f3dc2af tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:08.485512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5142a5d6-b3a7-4b93-9f04-cc215f3dc2af tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:08.493541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5142a5d6-b3a7-4b93-9f04-cc215f3dc2af tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:08.495025 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5142a5d6-b3a7-4b93-9f04-cc215f3dc2af tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:08.496171 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5142a5d6-b3a7-4b93-9f04-cc215f3dc2af tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.159438 Jul 04 05:59:08.496734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 364/719] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:08 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:08.820899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6109faf6-4dfd-4bd6-a703-8f1d3a11e6c6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:08.821545 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6109faf6-4dfd-4bd6-a703-8f1d3a11e6c6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:08.829113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6109faf6-4dfd-4bd6-a703-8f1d3a11e6c6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:08.829569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6109faf6-4dfd-4bd6-a703-8f1d3a11e6c6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:08.830337 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6109faf6-4dfd-4bd6-a703-8f1d3a11e6c6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:08.830780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6109faf6-4dfd-4bd6-a703-8f1d3a11e6c6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:08.868015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0c9f1f76-0a64-49c5-81f6-59e374b91cf3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:08.868598 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0c9f1f76-0a64-49c5-81f6-59e374b91cf3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:08.875800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c9f1f76-0a64-49c5-81f6-59e374b91cf3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:08.876259 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c9f1f76-0a64-49c5-81f6-59e374b91cf3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:08.877038 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c9f1f76-0a64-49c5-81f6-59e374b91cf3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:08.877474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c9f1f76-0a64-49c5-81f6-59e374b91cf3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:08.963960 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6109faf6-4dfd-4bd6-a703-8f1d3a11e6c6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:08.971710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6109faf6-4dfd-4bd6-a703-8f1d3a11e6c6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.154841 Jul 04 05:59:08.972287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 356/720] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:08 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:09.006530 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0c9f1f76-0a64-49c5-81f6-59e374b91cf3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:09.014437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0c9f1f76-0a64-49c5-81f6-59e374b91cf3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.150206 Jul 04 05:59:09.015015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 365/721] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:08 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:09.514168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8c15c8c4-3a08-4d57-96b8-c81a705bfb13 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:09.514821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8c15c8c4-3a08-4d57-96b8-c81a705bfb13 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:09.521311 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c15c8c4-3a08-4d57-96b8-c81a705bfb13 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:09.521875 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c15c8c4-3a08-4d57-96b8-c81a705bfb13 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:09.522655 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c15c8c4-3a08-4d57-96b8-c81a705bfb13 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:09.523093 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c15c8c4-3a08-4d57-96b8-c81a705bfb13 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:09.656237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8c15c8c4-3a08-4d57-96b8-c81a705bfb13 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:09.664264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8c15c8c4-3a08-4d57-96b8-c81a705bfb13 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:09.666109 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8c15c8c4-3a08-4d57-96b8-c81a705bfb13 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:09.667270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8c15c8c4-3a08-4d57-96b8-c81a705bfb13 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.157018 Jul 04 05:59:09.667832 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 357/722] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:09 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:09.992958 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c8cd586e-5dff-4887-a95c-ad55eb1ccc96 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:09.994169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c8cd586e-5dff-4887-a95c-ad55eb1ccc96 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:10.002893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8cd586e-5dff-4887-a95c-ad55eb1ccc96 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:10.003383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8cd586e-5dff-4887-a95c-ad55eb1ccc96 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:10.004157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8cd586e-5dff-4887-a95c-ad55eb1ccc96 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:10.004593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8cd586e-5dff-4887-a95c-ad55eb1ccc96 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:10.031427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c59aefa6-f90a-49ba-8c8b-cee53eefaa30 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:10.032041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c59aefa6-f90a-49ba-8c8b-cee53eefaa30 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:10.039277 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c59aefa6-f90a-49ba-8c8b-cee53eefaa30 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:10.039768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c59aefa6-f90a-49ba-8c8b-cee53eefaa30 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:10.040856 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c59aefa6-f90a-49ba-8c8b-cee53eefaa30 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:10.041290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c59aefa6-f90a-49ba-8c8b-cee53eefaa30 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:10.137971 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c8cd586e-5dff-4887-a95c-ad55eb1ccc96 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:10.146198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c8cd586e-5dff-4887-a95c-ad55eb1ccc96 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.159736 Jul 04 05:59:10.146772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 366/723] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:09 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:10.179085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c59aefa6-f90a-49ba-8c8b-cee53eefaa30 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:10.187009 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c59aefa6-f90a-49ba-8c8b-cee53eefaa30 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.159797 Jul 04 05:59:10.191432 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 358/724] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:10 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:10.689515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e56b7371-0a39-474b-a436-021f0d498c09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:10.690391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e56b7371-0a39-474b-a436-021f0d498c09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:10.698979 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e56b7371-0a39-474b-a436-021f0d498c09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:10.699632 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e56b7371-0a39-474b-a436-021f0d498c09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:10.700647 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e56b7371-0a39-474b-a436-021f0d498c09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:10.701263 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e56b7371-0a39-474b-a436-021f0d498c09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:10.847312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e56b7371-0a39-474b-a436-021f0d498c09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:10.856018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e56b7371-0a39-474b-a436-021f0d498c09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:10.858021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e56b7371-0a39-474b-a436-021f0d498c09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:10.859295 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e56b7371-0a39-474b-a436-021f0d498c09 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.176064 Jul 04 05:59:10.859880 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 367/725] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:10 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:11.164175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8928ddbe-8a69-4ce5-b166-b6340e0adc16 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:11.164768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8928ddbe-8a69-4ce5-b166-b6340e0adc16 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:11.172706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8928ddbe-8a69-4ce5-b166-b6340e0adc16 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:11.173212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8928ddbe-8a69-4ce5-b166-b6340e0adc16 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:11.174060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8928ddbe-8a69-4ce5-b166-b6340e0adc16 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:11.174549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8928ddbe-8a69-4ce5-b166-b6340e0adc16 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:11.204439 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-43f7ebb7-eaca-4486-8d97-afc9a18e0b92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:11.205027 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-43f7ebb7-eaca-4486-8d97-afc9a18e0b92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:11.212373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43f7ebb7-eaca-4486-8d97-afc9a18e0b92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:11.212931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43f7ebb7-eaca-4486-8d97-afc9a18e0b92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:11.213758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43f7ebb7-eaca-4486-8d97-afc9a18e0b92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:11.214376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43f7ebb7-eaca-4486-8d97-afc9a18e0b92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:11.308297 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8928ddbe-8a69-4ce5-b166-b6340e0adc16 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:11.316570 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8928ddbe-8a69-4ce5-b166-b6340e0adc16 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.156790 Jul 04 05:59:11.317181 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 359/726] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:11 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:11.346476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-43f7ebb7-eaca-4486-8d97-afc9a18e0b92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:11.359977 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-43f7ebb7-eaca-4486-8d97-afc9a18e0b92 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.159539 Jul 04 05:59:11.360579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 368/727] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:11 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:11.879278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9a5544c6-7980-4257-b918-251e86162912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:11.879909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9a5544c6-7980-4257-b918-251e86162912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:11.888100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a5544c6-7980-4257-b918-251e86162912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:11.888664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a5544c6-7980-4257-b918-251e86162912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:11.889645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a5544c6-7980-4257-b918-251e86162912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:11.890085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a5544c6-7980-4257-b918-251e86162912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:12.032366 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a5544c6-7980-4257-b918-251e86162912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:12.040780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a5544c6-7980-4257-b918-251e86162912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:12.042252 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a5544c6-7980-4257-b918-251e86162912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:12.043409 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9a5544c6-7980-4257-b918-251e86162912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.169302 Jul 04 05:59:12.043977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 360/728] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:11 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:12.339312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-497c4cdc-6de2-4a7c-8cef-11e9ab1c8fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:12.340367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-497c4cdc-6de2-4a7c-8cef-11e9ab1c8fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:12.351789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-497c4cdc-6de2-4a7c-8cef-11e9ab1c8fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:12.352541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-497c4cdc-6de2-4a7c-8cef-11e9ab1c8fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:12.353808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-497c4cdc-6de2-4a7c-8cef-11e9ab1c8fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:12.354534 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-497c4cdc-6de2-4a7c-8cef-11e9ab1c8fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:12.479613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c922131e-5dd6-4e78-b3b7-b26c99be3a1f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:12.480224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c922131e-5dd6-4e78-b3b7-b26c99be3a1f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:12.486628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c922131e-5dd6-4e78-b3b7-b26c99be3a1f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:12.487072 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c922131e-5dd6-4e78-b3b7-b26c99be3a1f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:12.487940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c922131e-5dd6-4e78-b3b7-b26c99be3a1f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:12.488280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c922131e-5dd6-4e78-b3b7-b26c99be3a1f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:12.490550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-497c4cdc-6de2-4a7c-8cef-11e9ab1c8fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:12.498101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-497c4cdc-6de2-4a7c-8cef-11e9ab1c8fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.166404 Jul 04 05:59:12.498706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 369/729] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:12 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:12.622848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c922131e-5dd6-4e78-b3b7-b26c99be3a1f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:12.630697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c922131e-5dd6-4e78-b3b7-b26c99be3a1f tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.257104 Jul 04 05:59:12.635325 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 361/730] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:12 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:13.065813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-58458c95-5847-47fd-afc2-2953c53f35c1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:13.066819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-58458c95-5847-47fd-afc2-2953c53f35c1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:13.077440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58458c95-5847-47fd-afc2-2953c53f35c1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:13.077885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58458c95-5847-47fd-afc2-2953c53f35c1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:13.078655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58458c95-5847-47fd-afc2-2953c53f35c1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:13.079091 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58458c95-5847-47fd-afc2-2953c53f35c1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:13.208777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-58458c95-5847-47fd-afc2-2953c53f35c1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:13.217167 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-58458c95-5847-47fd-afc2-2953c53f35c1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:13.218700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-58458c95-5847-47fd-afc2-2953c53f35c1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:13.219838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-58458c95-5847-47fd-afc2-2953c53f35c1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.160782 Jul 04 05:59:13.220393 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 370/731] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:13 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:13.519303 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff7bae69-5d82-4bbe-9767-7f6d50dab992 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:13.520447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff7bae69-5d82-4bbe-9767-7f6d50dab992 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:13.531278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff7bae69-5d82-4bbe-9767-7f6d50dab992 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:13.531741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff7bae69-5d82-4bbe-9767-7f6d50dab992 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:13.532498 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff7bae69-5d82-4bbe-9767-7f6d50dab992 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:13.532928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff7bae69-5d82-4bbe-9767-7f6d50dab992 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:13.648330 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3fb47163-6f49-412e-8ea7-68c4e0aa68e3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:13.648953 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3fb47163-6f49-412e-8ea7-68c4e0aa68e3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:13.655613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fb47163-6f49-412e-8ea7-68c4e0aa68e3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:13.656058 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fb47163-6f49-412e-8ea7-68c4e0aa68e3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:13.656827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fb47163-6f49-412e-8ea7-68c4e0aa68e3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:13.657260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fb47163-6f49-412e-8ea7-68c4e0aa68e3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:13.678863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ff7bae69-5d82-4bbe-9767-7f6d50dab992 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:13.686903 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff7bae69-5d82-4bbe-9767-7f6d50dab992 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.173855 Jul 04 05:59:13.687727 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 362/732] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:13 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:13.796221 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3fb47163-6f49-412e-8ea7-68c4e0aa68e3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:13.803857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3fb47163-6f49-412e-8ea7-68c4e0aa68e3 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.159424 Jul 04 05:59:13.804410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 371/733] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:13 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:14.239619 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d11f9d3-14d8-4fed-9151-9bca54087796 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:14.240333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d11f9d3-14d8-4fed-9151-9bca54087796 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:14.247867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d11f9d3-14d8-4fed-9151-9bca54087796 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:14.248453 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d11f9d3-14d8-4fed-9151-9bca54087796 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:14.249374 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d11f9d3-14d8-4fed-9151-9bca54087796 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:14.249803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d11f9d3-14d8-4fed-9151-9bca54087796 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:14.383763 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d11f9d3-14d8-4fed-9151-9bca54087796 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:14.396157 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d11f9d3-14d8-4fed-9151-9bca54087796 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:14.398561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d11f9d3-14d8-4fed-9151-9bca54087796 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:14.400325 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d11f9d3-14d8-4fed-9151-9bca54087796 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.165452 Jul 04 05:59:14.401179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 363/734] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:14 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:14.708997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1e8ef2ed-8e50-4ee6-bbb3-f0168517292f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:14.709856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1e8ef2ed-8e50-4ee6-bbb3-f0168517292f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:14.720930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e8ef2ed-8e50-4ee6-bbb3-f0168517292f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:14.721675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e8ef2ed-8e50-4ee6-bbb3-f0168517292f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:14.722937 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e8ef2ed-8e50-4ee6-bbb3-f0168517292f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:14.723717 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e8ef2ed-8e50-4ee6-bbb3-f0168517292f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:14.820946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e96dae48-cda0-4168-b48b-a0738574e715 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:14.821753 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e96dae48-cda0-4168-b48b-a0738574e715 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:14.829413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e96dae48-cda0-4168-b48b-a0738574e715 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:14.829736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e96dae48-cda0-4168-b48b-a0738574e715 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:14.830875 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e96dae48-cda0-4168-b48b-a0738574e715 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:14.831320 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e96dae48-cda0-4168-b48b-a0738574e715 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:14.862257 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1e8ef2ed-8e50-4ee6-bbb3-f0168517292f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:14.869899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1e8ef2ed-8e50-4ee6-bbb3-f0168517292f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.167517 Jul 04 05:59:14.870568 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 372/735] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:14 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:14.969222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e96dae48-cda0-4168-b48b-a0738574e715 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:14.977422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e96dae48-cda0-4168-b48b-a0738574e715 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.160272 Jul 04 05:59:14.977993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 364/736] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:14 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:15.428117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6be03c8d-e5aa-4b7e-8a64-1aeb3680dcbf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:15.429115 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6be03c8d-e5aa-4b7e-8a64-1aeb3680dcbf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:15.439350 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6be03c8d-e5aa-4b7e-8a64-1aeb3680dcbf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:15.440141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6be03c8d-e5aa-4b7e-8a64-1aeb3680dcbf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:15.441403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6be03c8d-e5aa-4b7e-8a64-1aeb3680dcbf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:15.442122 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6be03c8d-e5aa-4b7e-8a64-1aeb3680dcbf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:15.583762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6be03c8d-e5aa-4b7e-8a64-1aeb3680dcbf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:15.596234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6be03c8d-e5aa-4b7e-8a64-1aeb3680dcbf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:15.597704 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6be03c8d-e5aa-4b7e-8a64-1aeb3680dcbf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:15.598800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6be03c8d-e5aa-4b7e-8a64-1aeb3680dcbf tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.177372 Jul 04 05:59:15.599384 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 373/737] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:15 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:15.886994 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-485976d9-aa83-4e1e-8233-81452850662a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:15.887638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-485976d9-aa83-4e1e-8233-81452850662a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:15.894790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-485976d9-aa83-4e1e-8233-81452850662a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:15.895235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-485976d9-aa83-4e1e-8233-81452850662a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:15.896127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-485976d9-aa83-4e1e-8233-81452850662a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:15.896598 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-485976d9-aa83-4e1e-8233-81452850662a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:15.915729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:15.994105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-088aefa0-ef9f-43ba-87f4-8f530c2c43a2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:15.994824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-088aefa0-ef9f-43ba-87f4-8f530c2c43a2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:15.997756 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=80 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:16.003603 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-088aefa0-ef9f-43ba-87f4-8f530c2c43a2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:16.004050 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-088aefa0-ef9f-43ba-87f4-8f530c2c43a2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:16.004828 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-088aefa0-ef9f-43ba-87f4-8f530c2c43a2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:16.005259 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-088aefa0-ef9f-43ba-87f4-8f530c2c43a2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:16.037215 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-485976d9-aa83-4e1e-8233-81452850662a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:16.045285 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-485976d9-aa83-4e1e-8233-81452850662a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.162438 Jul 04 05:59:16.045889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 365/738] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:15 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:16.142314 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-088aefa0-ef9f-43ba-87f4-8f530c2c43a2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:16.150831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-088aefa0-ef9f-43ba-87f4-8f530c2c43a2 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.160603 Jul 04 05:59:16.151512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 374/739] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:15 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:16.621371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2524071-5af6-4944-a461-bd45751525fc tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:16.622204 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c2524071-5af6-4944-a461-bd45751525fc tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:16.631614 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2524071-5af6-4944-a461-bd45751525fc tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:16.632067 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2524071-5af6-4944-a461-bd45751525fc tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:16.632831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2524071-5af6-4944-a461-bd45751525fc tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:16.633268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2524071-5af6-4944-a461-bd45751525fc tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:16.762235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c2524071-5af6-4944-a461-bd45751525fc tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:16.770542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c2524071-5af6-4944-a461-bd45751525fc tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:16.772074 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c2524071-5af6-4944-a461-bd45751525fc tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:16.773179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2524071-5af6-4944-a461-bd45751525fc tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.158595 Jul 04 05:59:16.773747 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 366/740] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:16 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:17.066343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-81fb5b14-2e83-466d-93db-d6eca6845a1b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:17.067165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-81fb5b14-2e83-466d-93db-d6eca6845a1b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:17.074486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81fb5b14-2e83-466d-93db-d6eca6845a1b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:17.075015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81fb5b14-2e83-466d-93db-d6eca6845a1b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:17.075819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81fb5b14-2e83-466d-93db-d6eca6845a1b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:17.076251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81fb5b14-2e83-466d-93db-d6eca6845a1b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:17.169044 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c6d3fc21-fae3-470a-b242-1657c2af5b68 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:17.169645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c6d3fc21-fae3-470a-b242-1657c2af5b68 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:17.176679 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6d3fc21-fae3-470a-b242-1657c2af5b68 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:17.177379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6d3fc21-fae3-470a-b242-1657c2af5b68 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:17.178142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6d3fc21-fae3-470a-b242-1657c2af5b68 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:17.178569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6d3fc21-fae3-470a-b242-1657c2af5b68 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:17.209280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-81fb5b14-2e83-466d-93db-d6eca6845a1b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:17.218788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-81fb5b14-2e83-466d-93db-d6eca6845a1b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.158846 Jul 04 05:59:17.222535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 375/741] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:17 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:17.315360 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c6d3fc21-fae3-470a-b242-1657c2af5b68 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:17.323347 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c6d3fc21-fae3-470a-b242-1657c2af5b68 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.158631 Jul 04 05:59:17.323926 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 367/742] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:17 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:17.795730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a101914d-0e00-442f-85c6-481ecd38a912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:17.796606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a101914d-0e00-442f-85c6-481ecd38a912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:17.806964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a101914d-0e00-442f-85c6-481ecd38a912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:17.807762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a101914d-0e00-442f-85c6-481ecd38a912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:17.809027 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a101914d-0e00-442f-85c6-481ecd38a912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:17.809740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a101914d-0e00-442f-85c6-481ecd38a912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:17.955498 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a101914d-0e00-442f-85c6-481ecd38a912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:17.963630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a101914d-0e00-442f-85c6-481ecd38a912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:17.965155 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a101914d-0e00-442f-85c6-481ecd38a912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:17.966227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a101914d-0e00-442f-85c6-481ecd38a912 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.177885 Jul 04 05:59:17.966773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 376/743] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:17 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:18.239544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1089c601-d0a6-4cbf-8f87-f9c980f8d1e5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:18.240156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1089c601-d0a6-4cbf-8f87-f9c980f8d1e5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:18.247139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1089c601-d0a6-4cbf-8f87-f9c980f8d1e5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:18.247618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1089c601-d0a6-4cbf-8f87-f9c980f8d1e5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:18.248384 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1089c601-d0a6-4cbf-8f87-f9c980f8d1e5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:18.248815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1089c601-d0a6-4cbf-8f87-f9c980f8d1e5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:18.341547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3c557085-63e8-403b-b656-fa2f04ba1bd1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:18.342153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3c557085-63e8-403b-b656-fa2f04ba1bd1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:18.348469 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c557085-63e8-403b-b656-fa2f04ba1bd1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:18.348911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c557085-63e8-403b-b656-fa2f04ba1bd1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:18.349649 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c557085-63e8-403b-b656-fa2f04ba1bd1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:18.350284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c557085-63e8-403b-b656-fa2f04ba1bd1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:18.391583 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1089c601-d0a6-4cbf-8f87-f9c980f8d1e5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:18.399114 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1089c601-d0a6-4cbf-8f87-f9c980f8d1e5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.165738 Jul 04 05:59:18.399779 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 368/744] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:18 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:18.477481 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3c557085-63e8-403b-b656-fa2f04ba1bd1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:18.484912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3c557085-63e8-403b-b656-fa2f04ba1bd1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.147376 Jul 04 05:59:18.485478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 377/745] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:18 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:18.988153 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-10fe223b-58a8-45c0-833d-69f814496fa5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:18.989297 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-10fe223b-58a8-45c0-833d-69f814496fa5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:18.996128 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10fe223b-58a8-45c0-833d-69f814496fa5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:18.996575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10fe223b-58a8-45c0-833d-69f814496fa5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:18.997341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10fe223b-58a8-45c0-833d-69f814496fa5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:18.997777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10fe223b-58a8-45c0-833d-69f814496fa5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:19.166389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-10fe223b-58a8-45c0-833d-69f814496fa5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:19.177543 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-10fe223b-58a8-45c0-833d-69f814496fa5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:19.180394 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-10fe223b-58a8-45c0-833d-69f814496fa5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:19.181807 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-10fe223b-58a8-45c0-833d-69f814496fa5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.200096 Jul 04 05:59:19.192579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 369/746] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:18 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:19.420923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4d79b3b3-47ea-4894-8e76-8bd29a4a669b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:19.421779 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4d79b3b3-47ea-4894-8e76-8bd29a4a669b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:19.432836 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d79b3b3-47ea-4894-8e76-8bd29a4a669b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:19.433625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d79b3b3-47ea-4894-8e76-8bd29a4a669b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:19.435058 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d79b3b3-47ea-4894-8e76-8bd29a4a669b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:19.435604 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d79b3b3-47ea-4894-8e76-8bd29a4a669b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:19.502582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f48ed4c6-5996-423a-87bf-d7db7b6fe9e5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:19.504133 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f48ed4c6-5996-423a-87bf-d7db7b6fe9e5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:19.511705 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f48ed4c6-5996-423a-87bf-d7db7b6fe9e5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:19.512412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f48ed4c6-5996-423a-87bf-d7db7b6fe9e5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:19.513929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f48ed4c6-5996-423a-87bf-d7db7b6fe9e5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:19.516285 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f48ed4c6-5996-423a-87bf-d7db7b6fe9e5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:19.723753 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f48ed4c6-5996-423a-87bf-d7db7b6fe9e5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:19.732438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f48ed4c6-5996-423a-87bf-d7db7b6fe9e5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.233671 Jul 04 05:59:19.733212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 370/747] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:19 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:19.752861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4d79b3b3-47ea-4894-8e76-8bd29a4a669b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:19.760836 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4d79b3b3-47ea-4894-8e76-8bd29a4a669b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.346922 Jul 04 05:59:19.761416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 378/748] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:19 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:20.168320 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2839e16a-07c1-4f67-a46e-a1c8f1839085 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:59:20.169347 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2839e16a-07c1-4f67-a46e-a1c8f1839085 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:20.175867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2839e16a-07c1-4f67-a46e-a1c8f1839085 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:20.176314 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2839e16a-07c1-4f67-a46e-a1c8f1839085 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:20.177069 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2839e16a-07c1-4f67-a46e-a1c8f1839085 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:20.177537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2839e16a-07c1-4f67-a46e-a1c8f1839085 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:20.199848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9c28cb3b-76c1-4006-9c5a-a347b65f7eb7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:20.200049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-2839e16a-07c1-4f67-a46e-a1c8f1839085 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lazy-loading 'flavor' on Instance uuid 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 05:59:20.200378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9c28cb3b-76c1-4006-9c5a-a347b65f7eb7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:20.206776 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c28cb3b-76c1-4006-9c5a-a347b65f7eb7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:20.207225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c28cb3b-76c1-4006-9c5a-a347b65f7eb7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:20.208040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c28cb3b-76c1-4006-9c5a-a347b65f7eb7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:20.208476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c28cb3b-76c1-4006-9c5a-a347b65f7eb7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:20.336972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2839e16a-07c1-4f67-a46e-a1c8f1839085 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/action" status: 200 len: 32 microversion: 2.1 time: 0.172962 Jul 04 05:59:20.337615 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 371/749] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 05:59:20 2022] POST /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 05:59:20.347113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7fd594b7-1a6b-41a9-adab-1af59a030687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:20.347827 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7fd594b7-1a6b-41a9-adab-1af59a030687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:20.352471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9c28cb3b-76c1-4006-9c5a-a347b65f7eb7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:20.354501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fd594b7-1a6b-41a9-adab-1af59a030687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:20.354948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fd594b7-1a6b-41a9-adab-1af59a030687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:20.355735 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fd594b7-1a6b-41a9-adab-1af59a030687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:20.356166 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fd594b7-1a6b-41a9-adab-1af59a030687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:20.360581 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9c28cb3b-76c1-4006-9c5a-a347b65f7eb7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:20.362081 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9c28cb3b-76c1-4006-9c5a-a347b65f7eb7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:20.363195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9c28cb3b-76c1-4006-9c5a-a347b65f7eb7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.167411 Jul 04 05:59:20.363791 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 379/750] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:20 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:20.488817 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7fd594b7-1a6b-41a9-adab-1af59a030687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:20.496991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7fd594b7-1a6b-41a9-adab-1af59a030687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.154035 Jul 04 05:59:20.497548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 372/751] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:20 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:59:20.754184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4aa37c91-f5b9-423b-9d72-918cfd85be40 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:20.755152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4aa37c91-f5b9-423b-9d72-918cfd85be40 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:20.763634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4aa37c91-f5b9-423b-9d72-918cfd85be40 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:20.764125 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4aa37c91-f5b9-423b-9d72-918cfd85be40 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:20.764991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4aa37c91-f5b9-423b-9d72-918cfd85be40 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:20.765468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4aa37c91-f5b9-423b-9d72-918cfd85be40 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:20.769937 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:20.778590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e0fc6a4d-a7e4-4d9a-b842-ab2edd611e3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:20.779234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e0fc6a4d-a7e4-4d9a-b842-ab2edd611e3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:20.786773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0fc6a4d-a7e4-4d9a-b842-ab2edd611e3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:20.787379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0fc6a4d-a7e4-4d9a-b842-ab2edd611e3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:20.788153 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0fc6a4d-a7e4-4d9a-b842-ab2edd611e3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:20.788593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0fc6a4d-a7e4-4d9a-b842-ab2edd611e3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:21.066126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0fc6a4d-a7e4-4d9a-b842-ab2edd611e3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:21.074796 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e0fc6a4d-a7e4-4d9a-b842-ab2edd611e3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.300515 Jul 04 05:59:21.075796 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 373/752] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:20 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:21.323588 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4aa37c91-f5b9-423b-9d72-918cfd85be40 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:21.332100 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4aa37c91-f5b9-423b-9d72-918cfd85be40 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1661 microversion: 2.1 time: 0.584343 Jul 04 05:59:21.332885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 380/753] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:20 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1661 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:21.381462 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1cd10f0c-936c-4c45-ab98-bba61269ce0c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:21.382248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1cd10f0c-936c-4c45-ab98-bba61269ce0c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:21.388628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd10f0c-936c-4c45-ab98-bba61269ce0c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:21.389083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd10f0c-936c-4c45-ab98-bba61269ce0c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:21.389861 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd10f0c-936c-4c45-ab98-bba61269ce0c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:21.390301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd10f0c-936c-4c45-ab98-bba61269ce0c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:21.513954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-77560a04-fe4a-4af3-ad4e-d5392ed93971 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:21.514704 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-77560a04-fe4a-4af3-ad4e-d5392ed93971 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:21.521541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77560a04-fe4a-4af3-ad4e-d5392ed93971 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:21.522063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77560a04-fe4a-4af3-ad4e-d5392ed93971 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:21.523010 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77560a04-fe4a-4af3-ad4e-d5392ed93971 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:21.527949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77560a04-fe4a-4af3-ad4e-d5392ed93971 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:21.533570 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cd10f0c-936c-4c45-ab98-bba61269ce0c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:21.542098 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cd10f0c-936c-4c45-ab98-bba61269ce0c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:21.543602 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cd10f0c-936c-4c45-ab98-bba61269ce0c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:21.544728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1cd10f0c-936c-4c45-ab98-bba61269ce0c tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.167347 Jul 04 05:59:21.545273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 374/754] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:21 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:21.669553 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-77560a04-fe4a-4af3-ad4e-d5392ed93971 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:21.677696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-77560a04-fe4a-4af3-ad4e-d5392ed93971 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.167623 Jul 04 05:59:21.678290 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 381/755] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:59:22.094513 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-da2f319b-c4c0-4e1b-9b1e-3171c49aca62 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:22.096794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-da2f319b-c4c0-4e1b-9b1e-3171c49aca62 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:22.104649 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da2f319b-c4c0-4e1b-9b1e-3171c49aca62 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:22.106245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da2f319b-c4c0-4e1b-9b1e-3171c49aca62 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:22.107779 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da2f319b-c4c0-4e1b-9b1e-3171c49aca62 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:22.108440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da2f319b-c4c0-4e1b-9b1e-3171c49aca62 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:22.263203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-da2f319b-c4c0-4e1b-9b1e-3171c49aca62 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:22.270710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-da2f319b-c4c0-4e1b-9b1e-3171c49aca62 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.181118 Jul 04 05:59:22.271345 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 375/756] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:22 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:22.350175 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-89495dcc-7704-487b-845b-a97d7e8806eb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:22.350930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-89495dcc-7704-487b-845b-a97d7e8806eb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:22.358148 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89495dcc-7704-487b-845b-a97d7e8806eb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:22.358599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89495dcc-7704-487b-845b-a97d7e8806eb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:22.359431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89495dcc-7704-487b-845b-a97d7e8806eb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:22.359868 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89495dcc-7704-487b-845b-a97d7e8806eb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:22.527619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-89495dcc-7704-487b-845b-a97d7e8806eb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:22.541615 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-89495dcc-7704-487b-845b-a97d7e8806eb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1665 microversion: 2.1 time: 0.195300 Jul 04 05:59:22.542715 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 382/757] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:22 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1665 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:22.563157 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e3436584-a909-417e-ad8a-7142ff6de25d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:22.563792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e3436584-a909-417e-ad8a-7142ff6de25d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:22.566923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=80 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:22.573813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3436584-a909-417e-ad8a-7142ff6de25d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:22.574264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3436584-a909-417e-ad8a-7142ff6de25d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:22.575049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3436584-a909-417e-ad8a-7142ff6de25d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:22.575504 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3436584-a909-417e-ad8a-7142ff6de25d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:22.694134 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e70b8b7-a1fc-40aa-808b-96b104c30ffe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:22.694740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7e70b8b7-a1fc-40aa-808b-96b104c30ffe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:22.701706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e70b8b7-a1fc-40aa-808b-96b104c30ffe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:22.702301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e70b8b7-a1fc-40aa-808b-96b104c30ffe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:22.703095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e70b8b7-a1fc-40aa-808b-96b104c30ffe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:22.703556 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e70b8b7-a1fc-40aa-808b-96b104c30ffe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:22.713468 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e3436584-a909-417e-ad8a-7142ff6de25d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:22.722058 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e3436584-a909-417e-ad8a-7142ff6de25d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:22.723106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e3436584-a909-417e-ad8a-7142ff6de25d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:22.724251 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e3436584-a909-417e-ad8a-7142ff6de25d tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.165104 Jul 04 05:59:22.724865 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 376/758] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:22 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:22.837208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e70b8b7-a1fc-40aa-808b-96b104c30ffe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:22.848891 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7e70b8b7-a1fc-40aa-808b-96b104c30ffe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.158482 Jul 04 05:59:22.849750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 383/759] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:23.287691 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d11140f2-5d22-4cfa-86a9-9b75df845c0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:23.288314 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d11140f2-5d22-4cfa-86a9-9b75df845c0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:23.295790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d11140f2-5d22-4cfa-86a9-9b75df845c0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:23.296244 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d11140f2-5d22-4cfa-86a9-9b75df845c0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:23.297018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d11140f2-5d22-4cfa-86a9-9b75df845c0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:23.297434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d11140f2-5d22-4cfa-86a9-9b75df845c0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:23.431356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d11140f2-5d22-4cfa-86a9-9b75df845c0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:23.439553 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d11140f2-5d22-4cfa-86a9-9b75df845c0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.155689 Jul 04 05:59:23.440137 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 377/760] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:23 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:23.744226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e02e461-322c-4408-b8c5-05a3665fcac7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:23.744831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7e02e461-322c-4408-b8c5-05a3665fcac7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:23.751812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e02e461-322c-4408-b8c5-05a3665fcac7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:23.752258 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e02e461-322c-4408-b8c5-05a3665fcac7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:23.753021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e02e461-322c-4408-b8c5-05a3665fcac7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:23.753478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e02e461-322c-4408-b8c5-05a3665fcac7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:23.866065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a640183f-c529-4345-af0d-6710472e1b15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:23.866851 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a640183f-c529-4345-af0d-6710472e1b15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:23.873187 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a640183f-c529-4345-af0d-6710472e1b15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:23.873754 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a640183f-c529-4345-af0d-6710472e1b15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:23.874648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a640183f-c529-4345-af0d-6710472e1b15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:23.875185 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a640183f-c529-4345-af0d-6710472e1b15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:23.888428 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e02e461-322c-4408-b8c5-05a3665fcac7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:23.897965 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e02e461-322c-4408-b8c5-05a3665fcac7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:23.900017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e02e461-322c-4408-b8c5-05a3665fcac7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:23.901422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7e02e461-322c-4408-b8c5-05a3665fcac7 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.161574 Jul 04 05:59:23.902279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 384/761] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:23 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:24.011924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a640183f-c529-4345-af0d-6710472e1b15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:24.021000 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a640183f-c529-4345-af0d-6710472e1b15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.158772 Jul 04 05:59:24.021892 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 378/762] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:24.159395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-c1017a4c-8d31-4735-a144-aa230236e1e3 req-f00bd2a1-831f-4704-bba5-15b5e3b7124b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87fa4b2-597e-431a-bd5e-45f8c7395529", "name": "network-vif-plugged", "status": "completed", "tag": "787e112a-b1bf-41ce-b99d-6c3254cfc3aa"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:59:24.169088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-c1017a4c-8d31-4735-a144-aa230236e1e3 req-f00bd2a1-831f-4704-bba5-15b5e3b7124b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:24.169709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-c1017a4c-8d31-4735-a144-aa230236e1e3 req-f00bd2a1-831f-4704-bba5-15b5e3b7124b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:24.181622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-c1017a4c-8d31-4735-a144-aa230236e1e3 req-f00bd2a1-831f-4704-bba5-15b5e3b7124b service nova] Creating event network-vif-plugged:787e112a-b1bf-41ce-b99d-6c3254cfc3aa for instance a87fa4b2-597e-431a-bd5e-45f8c7395529 on hv-cinder-79733 Jul 04 05:59:24.187105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-c1017a4c-8d31-4735-a144-aa230236e1e3 req-f00bd2a1-831f-4704-bba5-15b5e3b7124b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031306 Jul 04 05:59:24.187854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 385/763] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:59:24.456601 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bb2d4b90-50a9-41ca-a559-0cd303725a6a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:24.457211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bb2d4b90-50a9-41ca-a559-0cd303725a6a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:24.464250 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb2d4b90-50a9-41ca-a559-0cd303725a6a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:24.464703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb2d4b90-50a9-41ca-a559-0cd303725a6a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:24.465468 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb2d4b90-50a9-41ca-a559-0cd303725a6a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:24.465918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb2d4b90-50a9-41ca-a559-0cd303725a6a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:24.602636 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bb2d4b90-50a9-41ca-a559-0cd303725a6a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:24.610432 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bb2d4b90-50a9-41ca-a559-0cd303725a6a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.157642 Jul 04 05:59:24.610934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 379/764] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:24 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:24.933165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-40a97034-1d3c-45d3-a236-af0bc954137e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:24.934328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-40a97034-1d3c-45d3-a236-af0bc954137e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:24.944485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40a97034-1d3c-45d3-a236-af0bc954137e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:24.944936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40a97034-1d3c-45d3-a236-af0bc954137e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:24.945706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40a97034-1d3c-45d3-a236-af0bc954137e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:24.946142 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40a97034-1d3c-45d3-a236-af0bc954137e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:25.038244 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-df704494-b873-4764-90c9-0f1a0a34438a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:25.038940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-df704494-b873-4764-90c9-0f1a0a34438a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:25.045465 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df704494-b873-4764-90c9-0f1a0a34438a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:25.045886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df704494-b873-4764-90c9-0f1a0a34438a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:25.046693 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df704494-b873-4764-90c9-0f1a0a34438a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:25.047135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df704494-b873-4764-90c9-0f1a0a34438a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:25.051197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:25.094390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40a97034-1d3c-45d3-a236-af0bc954137e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:25.102594 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40a97034-1d3c-45d3-a236-af0bc954137e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:25.104116 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40a97034-1d3c-45d3-a236-af0bc954137e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:25.105219 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-40a97034-1d3c-45d3-a236-af0bc954137e tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.179998 Jul 04 05:59:25.105774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 386/765] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:24 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:25.181886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df704494-b873-4764-90c9-0f1a0a34438a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:25.190941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-df704494-b873-4764-90c9-0f1a0a34438a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.156620 Jul 04 05:59:25.191471 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 380/766] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:25.627180 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0337d9f-cb46-4b8d-89cb-7de06268f9d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:25.627807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c0337d9f-cb46-4b8d-89cb-7de06268f9d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:25.634851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0337d9f-cb46-4b8d-89cb-7de06268f9d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:25.635334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0337d9f-cb46-4b8d-89cb-7de06268f9d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:25.636277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0337d9f-cb46-4b8d-89cb-7de06268f9d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:25.636713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0337d9f-cb46-4b8d-89cb-7de06268f9d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:25.773077 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c0337d9f-cb46-4b8d-89cb-7de06268f9d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:25.781076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c0337d9f-cb46-4b8d-89cb-7de06268f9d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.157755 Jul 04 05:59:25.781642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 387/767] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:25 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:26.123547 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-32ad0626-5167-4885-8653-6cc3c654e449 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:26.124148 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-32ad0626-5167-4885-8653-6cc3c654e449 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:26.130823 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32ad0626-5167-4885-8653-6cc3c654e449 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:26.131289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32ad0626-5167-4885-8653-6cc3c654e449 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:26.132094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32ad0626-5167-4885-8653-6cc3c654e449 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:26.132525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32ad0626-5167-4885-8653-6cc3c654e449 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:26.214238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c89940a3-75e8-4cd5-b8b5-23d941559fcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:26.214878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c89940a3-75e8-4cd5-b8b5-23d941559fcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:26.221951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c89940a3-75e8-4cd5-b8b5-23d941559fcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:26.222536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c89940a3-75e8-4cd5-b8b5-23d941559fcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:26.223573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c89940a3-75e8-4cd5-b8b5-23d941559fcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:26.224159 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c89940a3-75e8-4cd5-b8b5-23d941559fcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:26.276131 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32ad0626-5167-4885-8653-6cc3c654e449 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:26.288989 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32ad0626-5167-4885-8653-6cc3c654e449 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:26.290798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32ad0626-5167-4885-8653-6cc3c654e449 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:26.291984 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-32ad0626-5167-4885-8653-6cc3c654e449 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1405 microversion: 2.20 time: 0.172456 Jul 04 05:59:26.292548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 381/768] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:26 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:26.360600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c89940a3-75e8-4cd5-b8b5-23d941559fcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:26.369245 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c89940a3-75e8-4cd5-b8b5-23d941559fcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.158961 Jul 04 05:59:26.369819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 388/769] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:26.803593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff6d539e-46ec-40d0-9f82-7695352f6a07 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:26.804403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff6d539e-46ec-40d0-9f82-7695352f6a07 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:26.810706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff6d539e-46ec-40d0-9f82-7695352f6a07 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:26.811163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff6d539e-46ec-40d0-9f82-7695352f6a07 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:26.811976 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff6d539e-46ec-40d0-9f82-7695352f6a07 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:26.812405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff6d539e-46ec-40d0-9f82-7695352f6a07 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:26.961803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ff6d539e-46ec-40d0-9f82-7695352f6a07 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:26.970882 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff6d539e-46ec-40d0-9f82-7695352f6a07 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.172563 Jul 04 05:59:26.971522 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 382/770] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:26 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:27.313427 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f3c1e213-4289-4f41-8007-f70298c34a02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:27.314185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f3c1e213-4289-4f41-8007-f70298c34a02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:27.327475 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3c1e213-4289-4f41-8007-f70298c34a02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:27.327936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3c1e213-4289-4f41-8007-f70298c34a02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:27.328707 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3c1e213-4289-4f41-8007-f70298c34a02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:27.329141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3c1e213-4289-4f41-8007-f70298c34a02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:27.386714 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f330cd09-ec8a-4eb2-b178-984f8e2d3e79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:27.387399 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f330cd09-ec8a-4eb2-b178-984f8e2d3e79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:27.394128 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f330cd09-ec8a-4eb2-b178-984f8e2d3e79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:27.394652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f330cd09-ec8a-4eb2-b178-984f8e2d3e79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:27.395544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f330cd09-ec8a-4eb2-b178-984f8e2d3e79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:27.396074 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f330cd09-ec8a-4eb2-b178-984f8e2d3e79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:27.468709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f3c1e213-4289-4f41-8007-f70298c34a02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:27.483356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f3c1e213-4289-4f41-8007-f70298c34a02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:27.484856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f3c1e213-4289-4f41-8007-f70298c34a02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:27.486036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f3c1e213-4289-4f41-8007-f70298c34a02 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1596 microversion: 2.20 time: 0.179168 Jul 04 05:59:27.486690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 389/771] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 05:59:27 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1596 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 05:59:27.510402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f7c57528-4ea5-4777-be63-c91b65ddcfab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:27.510878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f7c57528-4ea5-4777-be63-c91b65ddcfab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:27.516983 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c57528-4ea5-4777-be63-c91b65ddcfab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:27.517431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c57528-4ea5-4777-be63-c91b65ddcfab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:27.518491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c57528-4ea5-4777-be63-c91b65ddcfab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:27.518616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c57528-4ea5-4777-be63-c91b65ddcfab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:27.545281 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f330cd09-ec8a-4eb2-b178-984f8e2d3e79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:27.553446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f330cd09-ec8a-4eb2-b178-984f8e2d3e79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.170684 Jul 04 05:59:27.554024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 383/772] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:27.596370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f7c57528-4ea5-4777-be63-c91b65ddcfab tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089963 Jul 04 05:59:27.596970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 390/773] 10.222.0.42 () {60 vars in 1315 bytes} [Mon Jul 4 05:59:27 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 05:59:27.988096 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b82a3b85-9dd9-44bf-bf8e-030bed984b31 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:27.988745 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b82a3b85-9dd9-44bf-bf8e-030bed984b31 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:27.995279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b82a3b85-9dd9-44bf-bf8e-030bed984b31 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:27.995743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b82a3b85-9dd9-44bf-bf8e-030bed984b31 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:27.996520 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b82a3b85-9dd9-44bf-bf8e-030bed984b31 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:27.996957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b82a3b85-9dd9-44bf-bf8e-030bed984b31 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:28.128658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b82a3b85-9dd9-44bf-bf8e-030bed984b31 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:28.136579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b82a3b85-9dd9-44bf-bf8e-030bed984b31 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.152445 Jul 04 05:59:28.137346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 384/774] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:27 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:28.513431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-8a3403d0-1259-4263-bca7-3b5d9579a9ef req-3c7f8862-8cb5-4f4e-8f8c-3a6b07806cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87fa4b2-597e-431a-bd5e-45f8c7395529", "tag": "787e112a-b1bf-41ce-b99d-6c3254cfc3aa"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:59:28.524189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-8a3403d0-1259-4263-bca7-3b5d9579a9ef req-3c7f8862-8cb5-4f4e-8f8c-3a6b07806cb2 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:28.524637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-8a3403d0-1259-4263-bca7-3b5d9579a9ef req-3c7f8862-8cb5-4f4e-8f8c-3a6b07806cb2 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:28.536710 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-8a3403d0-1259-4263-bca7-3b5d9579a9ef req-3c7f8862-8cb5-4f4e-8f8c-3a6b07806cb2 service nova] Creating event network-changed:787e112a-b1bf-41ce-b99d-6c3254cfc3aa for instance a87fa4b2-597e-431a-bd5e-45f8c7395529 on hv-cinder-79733 Jul 04 05:59:28.552333 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-8a3403d0-1259-4263-bca7-3b5d9579a9ef req-3c7f8862-8cb5-4f4e-8f8c-3a6b07806cb2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043665 Jul 04 05:59:28.553300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 391/775] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:59:28.569991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c714791c-2a59-4b6e-ae67-0b9a6d1c9987 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:28.570600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c714791c-2a59-4b6e-ae67-0b9a6d1c9987 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:28.577278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c714791c-2a59-4b6e-ae67-0b9a6d1c9987 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:28.577729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c714791c-2a59-4b6e-ae67-0b9a6d1c9987 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:28.578504 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c714791c-2a59-4b6e-ae67-0b9a6d1c9987 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:28.578942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c714791c-2a59-4b6e-ae67-0b9a6d1c9987 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:28.715309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c714791c-2a59-4b6e-ae67-0b9a6d1c9987 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:28.726928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c714791c-2a59-4b6e-ae67-0b9a6d1c9987 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.160602 Jul 04 05:59:28.733246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 385/776] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:29.154316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9dae2684-5801-4ad8-8304-a20238881d3f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:29.155353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9dae2684-5801-4ad8-8304-a20238881d3f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:29.164537 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9dae2684-5801-4ad8-8304-a20238881d3f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:29.165161 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9dae2684-5801-4ad8-8304-a20238881d3f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:29.165948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9dae2684-5801-4ad8-8304-a20238881d3f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:29.166532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9dae2684-5801-4ad8-8304-a20238881d3f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:29.305534 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9dae2684-5801-4ad8-8304-a20238881d3f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:29.313379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9dae2684-5801-4ad8-8304-a20238881d3f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.164304 Jul 04 05:59:29.313965 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 392/777] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:29 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:29.745069 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eae27e73-4c61-40be-91bc-43f4d640d9e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:29.745705 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eae27e73-4c61-40be-91bc-43f4d640d9e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:29.752239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eae27e73-4c61-40be-91bc-43f4d640d9e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:29.752685 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eae27e73-4c61-40be-91bc-43f4d640d9e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:29.753484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eae27e73-4c61-40be-91bc-43f4d640d9e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:29.753917 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eae27e73-4c61-40be-91bc-43f4d640d9e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:29.883612 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eae27e73-4c61-40be-91bc-43f4d640d9e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:29.891963 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eae27e73-4c61-40be-91bc-43f4d640d9e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.150747 Jul 04 05:59:29.892535 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 386/778] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:30.332152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-32c00c04-86dd-4b8e-b1a8-575141ada9f5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:30.332828 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-32c00c04-86dd-4b8e-b1a8-575141ada9f5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:30.341358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32c00c04-86dd-4b8e-b1a8-575141ada9f5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:30.341911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32c00c04-86dd-4b8e-b1a8-575141ada9f5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:30.342851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32c00c04-86dd-4b8e-b1a8-575141ada9f5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:30.343441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32c00c04-86dd-4b8e-b1a8-575141ada9f5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:30.482707 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-32c00c04-86dd-4b8e-b1a8-575141ada9f5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:30.490645 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-32c00c04-86dd-4b8e-b1a8-575141ada9f5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.163362 Jul 04 05:59:30.491226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 393/779] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:30 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:30.909234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-209155bd-72c4-44f1-a836-cbe950f3187a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:30.909745 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-209155bd-72c4-44f1-a836-cbe950f3187a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:30.916896 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-209155bd-72c4-44f1-a836-cbe950f3187a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:30.917338 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-209155bd-72c4-44f1-a836-cbe950f3187a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:30.918084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-209155bd-72c4-44f1-a836-cbe950f3187a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:30.918517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-209155bd-72c4-44f1-a836-cbe950f3187a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:31.056662 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-209155bd-72c4-44f1-a836-cbe950f3187a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:31.065233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-209155bd-72c4-44f1-a836-cbe950f3187a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.159997 Jul 04 05:59:31.065772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 387/780] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:30 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:31.507707 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6ed7c3ff-37f2-4deb-a1e8-15f30369d039 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:31.508291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6ed7c3ff-37f2-4deb-a1e8-15f30369d039 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:31.515972 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ed7c3ff-37f2-4deb-a1e8-15f30369d039 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:31.516467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ed7c3ff-37f2-4deb-a1e8-15f30369d039 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:31.517301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ed7c3ff-37f2-4deb-a1e8-15f30369d039 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:31.517752 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ed7c3ff-37f2-4deb-a1e8-15f30369d039 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:31.650032 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6ed7c3ff-37f2-4deb-a1e8-15f30369d039 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:31.658117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6ed7c3ff-37f2-4deb-a1e8-15f30369d039 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.154572 Jul 04 05:59:31.658685 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 394/781] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:31 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:32.083137 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55da77de-55b8-499d-9813-39311de22d81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:32.083683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-55da77de-55b8-499d-9813-39311de22d81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:32.091071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55da77de-55b8-499d-9813-39311de22d81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:32.091554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55da77de-55b8-499d-9813-39311de22d81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:32.092312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55da77de-55b8-499d-9813-39311de22d81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:32.092739 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55da77de-55b8-499d-9813-39311de22d81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:32.233969 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-55da77de-55b8-499d-9813-39311de22d81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:32.242669 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-55da77de-55b8-499d-9813-39311de22d81 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.163713 Jul 04 05:59:32.243239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 388/782] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:32 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:32.679555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f55799c3-355d-454c-9b3c-b140223a66c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:32.680163 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f55799c3-355d-454c-9b3c-b140223a66c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:32.687162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f55799c3-355d-454c-9b3c-b140223a66c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:32.687646 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f55799c3-355d-454c-9b3c-b140223a66c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:32.688422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f55799c3-355d-454c-9b3c-b140223a66c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:32.688845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f55799c3-355d-454c-9b3c-b140223a66c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:32.822826 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f55799c3-355d-454c-9b3c-b140223a66c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:32.830872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f55799c3-355d-454c-9b3c-b140223a66c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.157745 Jul 04 05:59:32.831813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 395/783] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:32 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:33.263894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75407a59-e5b0-4d97-9ba0-81d58c208b0a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:33.264939 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-75407a59-e5b0-4d97-9ba0-81d58c208b0a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:33.276098 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75407a59-e5b0-4d97-9ba0-81d58c208b0a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:33.276851 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75407a59-e5b0-4d97-9ba0-81d58c208b0a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:33.278105 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75407a59-e5b0-4d97-9ba0-81d58c208b0a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:33.278824 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75407a59-e5b0-4d97-9ba0-81d58c208b0a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:33.416574 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-75407a59-e5b0-4d97-9ba0-81d58c208b0a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:33.425231 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-75407a59-e5b0-4d97-9ba0-81d58c208b0a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.167979 Jul 04 05:59:33.425773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 389/784] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:33.849307 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-afcf17cd-6801-40b0-9ee4-b52c22bce155 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:33.849915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-afcf17cd-6801-40b0-9ee4-b52c22bce155 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:33.856907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-afcf17cd-6801-40b0-9ee4-b52c22bce155 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:33.857355 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-afcf17cd-6801-40b0-9ee4-b52c22bce155 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:33.858121 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-afcf17cd-6801-40b0-9ee4-b52c22bce155 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:33.858559 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-afcf17cd-6801-40b0-9ee4-b52c22bce155 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:33.990084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-afcf17cd-6801-40b0-9ee4-b52c22bce155 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:34.005984 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-afcf17cd-6801-40b0-9ee4-b52c22bce155 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.159650 Jul 04 05:59:34.006846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 396/785] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:33 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:34.442727 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4469ff1c-fc2e-4684-90dd-63b5eaefcc51 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:34.443366 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4469ff1c-fc2e-4684-90dd-63b5eaefcc51 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:34.450436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4469ff1c-fc2e-4684-90dd-63b5eaefcc51 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:34.451040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4469ff1c-fc2e-4684-90dd-63b5eaefcc51 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:34.451846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4469ff1c-fc2e-4684-90dd-63b5eaefcc51 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:34.452275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4469ff1c-fc2e-4684-90dd-63b5eaefcc51 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:34.590343 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4469ff1c-fc2e-4684-90dd-63b5eaefcc51 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:34.598707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4469ff1c-fc2e-4684-90dd-63b5eaefcc51 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.160100 Jul 04 05:59:34.599289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 390/786] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:35.031637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6aa066ed-9270-4fd2-91f5-359fe6565cf8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:35.033254 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6aa066ed-9270-4fd2-91f5-359fe6565cf8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:35.043198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aa066ed-9270-4fd2-91f5-359fe6565cf8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:35.043689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aa066ed-9270-4fd2-91f5-359fe6565cf8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:35.044443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aa066ed-9270-4fd2-91f5-359fe6565cf8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:35.044879 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aa066ed-9270-4fd2-91f5-359fe6565cf8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:35.189416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6aa066ed-9270-4fd2-91f5-359fe6565cf8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:35.197285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6aa066ed-9270-4fd2-91f5-359fe6565cf8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.173809 Jul 04 05:59:35.197858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 397/787] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:35 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:35.620020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2db307b4-b91f-4ab4-b95f-3d9782115f45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:35.620640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2db307b4-b91f-4ab4-b95f-3d9782115f45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:35.628415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2db307b4-b91f-4ab4-b95f-3d9782115f45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:35.628916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2db307b4-b91f-4ab4-b95f-3d9782115f45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:35.629770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2db307b4-b91f-4ab4-b95f-3d9782115f45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:35.632176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2db307b4-b91f-4ab4-b95f-3d9782115f45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:35.773840 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2db307b4-b91f-4ab4-b95f-3d9782115f45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:35.781988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2db307b4-b91f-4ab4-b95f-3d9782115f45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.167905 Jul 04 05:59:35.782557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 391/788] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:36.215796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9888174e-a00e-45c9-bcfe-89e7aad1b95e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:36.216705 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9888174e-a00e-45c9-bcfe-89e7aad1b95e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:36.225325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9888174e-a00e-45c9-bcfe-89e7aad1b95e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:36.225886 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9888174e-a00e-45c9-bcfe-89e7aad1b95e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:36.226853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9888174e-a00e-45c9-bcfe-89e7aad1b95e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:36.227417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9888174e-a00e-45c9-bcfe-89e7aad1b95e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:36.248897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:36.364135 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9888174e-a00e-45c9-bcfe-89e7aad1b95e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:36.374019 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9888174e-a00e-45c9-bcfe-89e7aad1b95e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.162842 Jul 04 05:59:36.374998 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 398/789] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:36 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:36.803963 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-57dd9b03-d95c-4d82-910c-cbd3f6ee6ae9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:36.804947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-57dd9b03-d95c-4d82-910c-cbd3f6ee6ae9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:36.813034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57dd9b03-d95c-4d82-910c-cbd3f6ee6ae9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:36.813487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57dd9b03-d95c-4d82-910c-cbd3f6ee6ae9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:36.814255 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57dd9b03-d95c-4d82-910c-cbd3f6ee6ae9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:36.814696 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57dd9b03-d95c-4d82-910c-cbd3f6ee6ae9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:36.955803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-57dd9b03-d95c-4d82-910c-cbd3f6ee6ae9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:36.964687 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-57dd9b03-d95c-4d82-910c-cbd3f6ee6ae9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1714 microversion: 2.1 time: 0.167258 Jul 04 05:59:36.965511 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 392/790] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1714 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:37.070574 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4bd3e93-d81c-48ce-8bb6-6784df1331a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:37.071073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f4bd3e93-d81c-48ce-8bb6-6784df1331a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:37.077650 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4bd3e93-d81c-48ce-8bb6-6784df1331a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:37.078099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4bd3e93-d81c-48ce-8bb6-6784df1331a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:37.078860 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4bd3e93-d81c-48ce-8bb6-6784df1331a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:37.079282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4bd3e93-d81c-48ce-8bb6-6784df1331a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:37.165038 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-f4bd3e93-d81c-48ce-8bb6-6784df1331a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] HTTP exception thrown: Cannot 'detach_volume' instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 while it is in vm_state rescued Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4bd3e93-d81c-48ce-8bb6-6784df1331a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Request method failure captured: Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments/894fb4af-f3ce-4764-814d-ad6e790e7fa5 HTTP/1.1 Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoDWduuQd-4LtLNBEsfndOQNnXdCxbhhefkVWxp7Albf8nz6dEzS5A6jt7Yk4-6ho1E-i8y4BxVlVPtK6kmSp7NVCcP2VYorrWW6H95pQXHmX2qA8R11XcUz1Tm7EZIHyhBTnPj1d2JHdR1z7jukPed2TtJYhxuENM3DtP7zltIxXrg Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 27aa4fc6d2bd46d3a3492cf0b1d7ae9d Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 05:59:37.167214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 05:59:37.168764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 05:59:37.168764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 05:59:37.168764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 27aa4fc6d2bd46d3a3492cf0b1d7ae9d Jul 04 05:59:37.168764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 05:59:37.168764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-ServerRescueNegativeTestJSON-1901791098-project Jul 04 05:59:37.168764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 05:59:37.168764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 05:59:37.168764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 93ae888c6e364e2e96ff52e63415a0e5 Jul 04 05:59:37.168764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1901791098-project Jul 04 05:59:37.168764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 05:59:37.168764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Cannot 'detach_volume' instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 while it is in vm_state rescued Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'server_id': '6141b5a5-5e40-4d2e-afb1-ff85c45f0620', 'id': '894fb4af-f3ce-4764-814d-ad6e790e7fa5'} Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 05:59:37.169536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 while it is in vm_state rescued Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 while it is in vm_state rescued Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 05:59:37.171003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4bd3e93-d81c-48ce-8bb6-6784df1331a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Returning 409 to user: Cannot 'detach_volume' instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 while it is in vm_state rescued {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 05:59:37.172180 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f4bd3e93-d81c-48ce-8bb6-6784df1331a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments/894fb4af-f3ce-4764-814d-ad6e790e7fa5" status: 409 len: 152 microversion: 2.1 time: 0.102234 Jul 04 05:59:37.172180 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 399/791] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jul 4 05:59:37 2022] DELETE /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments/894fb4af-f3ce-4764-814d-ad6e790e7fa5 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 04 05:59:37.177864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a86e7b4d-7f0a-431d-a30e-e4739d78ca80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:59:37.178394 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a86e7b4d-7f0a-431d-a30e-e4739d78ca80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:37.184643 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a86e7b4d-7f0a-431d-a30e-e4739d78ca80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:37.185098 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a86e7b4d-7f0a-431d-a30e-e4739d78ca80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:37.185857 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a86e7b4d-7f0a-431d-a30e-e4739d78ca80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:37.186294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a86e7b4d-7f0a-431d-a30e-e4739d78ca80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:37.256146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a86e7b4d-7f0a-431d-a30e-e4739d78ca80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/action" status: 202 len: 0 microversion: 2.1 time: 0.082043 Jul 04 05:59:37.256766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 393/792] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 05:59:37 2022] POST /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 05:59:37.265142 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6db33639-d2ac-42ce-81c5-4c99dc40409b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:37.265753 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6db33639-d2ac-42ce-81c5-4c99dc40409b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:37.272230 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6db33639-d2ac-42ce-81c5-4c99dc40409b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:37.272679 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6db33639-d2ac-42ce-81c5-4c99dc40409b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:37.273496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6db33639-d2ac-42ce-81c5-4c99dc40409b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:37.273896 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6db33639-d2ac-42ce-81c5-4c99dc40409b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:37.391932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-39eb5208-3a29-4d11-b04e-d823e9e89f92 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:37.392674 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-39eb5208-3a29-4d11-b04e-d823e9e89f92 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:37.399280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39eb5208-3a29-4d11-b04e-d823e9e89f92 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:37.399751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39eb5208-3a29-4d11-b04e-d823e9e89f92 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:37.400548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39eb5208-3a29-4d11-b04e-d823e9e89f92 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:37.400965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39eb5208-3a29-4d11-b04e-d823e9e89f92 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:37.509942 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6db33639-d2ac-42ce-81c5-4c99dc40409b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:37.523273 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6db33639-d2ac-42ce-81c5-4c99dc40409b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1722 microversion: 2.1 time: 0.261923 Jul 04 05:59:37.533256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 400/793] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:37.537210 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-39eb5208-3a29-4d11-b04e-d823e9e89f92 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:37.545158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-39eb5208-3a29-4d11-b04e-d823e9e89f92 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.157610 Jul 04 05:59:37.545726 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 394/794] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:37 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:38.541427 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-20d377c0-3997-4fed-9a49-47ba975a212d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:38.542029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-20d377c0-3997-4fed-9a49-47ba975a212d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:38.549101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20d377c0-3997-4fed-9a49-47ba975a212d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:38.549609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20d377c0-3997-4fed-9a49-47ba975a212d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:38.550364 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20d377c0-3997-4fed-9a49-47ba975a212d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:38.550835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20d377c0-3997-4fed-9a49-47ba975a212d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:38.562045 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bef71b49-8b21-4ebd-9271-29aa69a5c4d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:38.562606 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bef71b49-8b21-4ebd-9271-29aa69a5c4d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:38.570233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bef71b49-8b21-4ebd-9271-29aa69a5c4d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:38.570431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bef71b49-8b21-4ebd-9271-29aa69a5c4d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:38.571475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bef71b49-8b21-4ebd-9271-29aa69a5c4d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:38.571918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bef71b49-8b21-4ebd-9271-29aa69a5c4d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:38.681254 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20d377c0-3997-4fed-9a49-47ba975a212d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:38.689331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-20d377c0-3997-4fed-9a49-47ba975a212d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1722 microversion: 2.1 time: 0.152264 Jul 04 05:59:38.689905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 401/795] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:38.702613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bef71b49-8b21-4ebd-9271-29aa69a5c4d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:38.706245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:38.710887 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bef71b49-8b21-4ebd-9271-29aa69a5c4d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.152635 Jul 04 05:59:38.711488 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 395/796] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:38 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:39.711117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-965e28de-7ba8-4655-8d82-f71eb282a2f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:39.712165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-965e28de-7ba8-4655-8d82-f71eb282a2f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:39.723130 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-965e28de-7ba8-4655-8d82-f71eb282a2f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:39.723943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-965e28de-7ba8-4655-8d82-f71eb282a2f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:39.725196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-965e28de-7ba8-4655-8d82-f71eb282a2f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:39.725921 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-965e28de-7ba8-4655-8d82-f71eb282a2f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:39.731090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0140f139-afb2-4f51-a12a-36c0ce955e10 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:39.731758 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0140f139-afb2-4f51-a12a-36c0ce955e10 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:39.739179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0140f139-afb2-4f51-a12a-36c0ce955e10 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:39.739667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0140f139-afb2-4f51-a12a-36c0ce955e10 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:39.740434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0140f139-afb2-4f51-a12a-36c0ce955e10 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:39.740871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0140f139-afb2-4f51-a12a-36c0ce955e10 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:39.860819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-965e28de-7ba8-4655-8d82-f71eb282a2f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:39.868859 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-965e28de-7ba8-4655-8d82-f71eb282a2f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1722 microversion: 2.1 time: 0.164222 Jul 04 05:59:39.869445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 402/797] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:39.879657 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0140f139-afb2-4f51-a12a-36c0ce955e10 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:39.887652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0140f139-afb2-4f51-a12a-36c0ce955e10 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.162496 Jul 04 05:59:39.888211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 396/798] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:39 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:59:40.885984 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6a19d566-796e-4d90-a525-5011e899f0d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:40.886559 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6a19d566-796e-4d90-a525-5011e899f0d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:40.893492 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a19d566-796e-4d90-a525-5011e899f0d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:40.893946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a19d566-796e-4d90-a525-5011e899f0d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:40.894715 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a19d566-796e-4d90-a525-5011e899f0d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:40.895152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a19d566-796e-4d90-a525-5011e899f0d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:40.905342 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-758f64bf-5fc1-4d7d-88bd-aa71099abc9d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:40.905998 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-758f64bf-5fc1-4d7d-88bd-aa71099abc9d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:40.913032 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-758f64bf-5fc1-4d7d-88bd-aa71099abc9d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:40.913609 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-758f64bf-5fc1-4d7d-88bd-aa71099abc9d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:40.915007 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-758f64bf-5fc1-4d7d-88bd-aa71099abc9d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:40.915704 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-758f64bf-5fc1-4d7d-88bd-aa71099abc9d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:41.030387 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6a19d566-796e-4d90-a525-5011e899f0d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:41.038506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6a19d566-796e-4d90-a525-5011e899f0d6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1728 microversion: 2.1 time: 0.156546 Jul 04 05:59:41.039420 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 403/799] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:41.050357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-758f64bf-5fc1-4d7d-88bd-aa71099abc9d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:41.055495 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c7a96940-df2a-4a43-815d-df60cea603a1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:41.055989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c7a96940-df2a-4a43-815d-df60cea603a1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:41.058119 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-758f64bf-5fc1-4d7d-88bd-aa71099abc9d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.157082 Jul 04 05:59:41.059013 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 397/800] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:40 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:41.062954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7a96940-df2a-4a43-815d-df60cea603a1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:41.063412 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7a96940-df2a-4a43-815d-df60cea603a1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:41.064183 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7a96940-df2a-4a43-815d-df60cea603a1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:41.064625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7a96940-df2a-4a43-815d-df60cea603a1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:41.142813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c7a96940-df2a-4a43-815d-df60cea603a1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091190 Jul 04 05:59:41.143456 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 404/801] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jul 4 05:59:41 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:59:42.074827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d894f70c-3ed6-48a4-aae5-6658fcb7d2b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:42.076551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d894f70c-3ed6-48a4-aae5-6658fcb7d2b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:42.083634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d894f70c-3ed6-48a4-aae5-6658fcb7d2b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:42.084123 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d894f70c-3ed6-48a4-aae5-6658fcb7d2b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:42.084907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d894f70c-3ed6-48a4-aae5-6658fcb7d2b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:42.085304 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d894f70c-3ed6-48a4-aae5-6658fcb7d2b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:42.113339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-56e6b0cd-af81-4732-b944-7ad42feb8122 req-59d6bc3c-5104-4b22-b36c-192b3ad157bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6141b5a5-5e40-4d2e-afb1-ff85c45f0620", "tag": "1015e693-9c03-489d-bc15-506c5f4f1b3b"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:59:42.122259 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-56e6b0cd-af81-4732-b944-7ad42feb8122 req-59d6bc3c-5104-4b22-b36c-192b3ad157bf service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:42.122831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-56e6b0cd-af81-4732-b944-7ad42feb8122 req-59d6bc3c-5104-4b22-b36c-192b3ad157bf service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:42.134820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-56e6b0cd-af81-4732-b944-7ad42feb8122 req-59d6bc3c-5104-4b22-b36c-192b3ad157bf service nova] Creating event network-changed:1015e693-9c03-489d-bc15-506c5f4f1b3b for instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 on hv-cinder-79733 Jul 04 05:59:42.140162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-56e6b0cd-af81-4732-b944-7ad42feb8122 req-59d6bc3c-5104-4b22-b36c-192b3ad157bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097209 Jul 04 05:59:42.140872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 398/802] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:59:42.274232 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d894f70c-3ed6-48a4-aae5-6658fcb7d2b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:42.283209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d894f70c-3ed6-48a4-aae5-6658fcb7d2b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.212909 Jul 04 05:59:42.284235 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 405/803] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:42 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 05:59:43.301358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cc039bd3-1f1a-4653-a7f3-b49001a80159 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:43.302090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cc039bd3-1f1a-4653-a7f3-b49001a80159 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:43.308661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc039bd3-1f1a-4653-a7f3-b49001a80159 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:43.309111 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc039bd3-1f1a-4653-a7f3-b49001a80159 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:43.309888 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc039bd3-1f1a-4653-a7f3-b49001a80159 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:43.310324 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc039bd3-1f1a-4653-a7f3-b49001a80159 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:43.449550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cc039bd3-1f1a-4653-a7f3-b49001a80159 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:43.457939 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cc039bd3-1f1a-4653-a7f3-b49001a80159 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.161380 Jul 04 05:59:43.458481 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 399/804] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:43 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:44.164865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-1299943f-068a-4021-82bb-bb3911b8965b req-22d66786-8e53-4889-9b82-6d92904c3ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6141b5a5-5e40-4d2e-afb1-ff85c45f0620", "tag": "1015e693-9c03-489d-bc15-506c5f4f1b3b"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 05:59:44.175623 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-1299943f-068a-4021-82bb-bb3911b8965b req-22d66786-8e53-4889-9b82-6d92904c3ab3 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:44.176077 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-1299943f-068a-4021-82bb-bb3911b8965b req-22d66786-8e53-4889-9b82-6d92904c3ab3 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:44.187400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-1299943f-068a-4021-82bb-bb3911b8965b req-22d66786-8e53-4889-9b82-6d92904c3ab3 service nova] Creating event network-changed:1015e693-9c03-489d-bc15-506c5f4f1b3b for instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 on hv-cinder-79733 Jul 04 05:59:44.192696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-1299943f-068a-4021-82bb-bb3911b8965b req-22d66786-8e53-4889-9b82-6d92904c3ab3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034733 Jul 04 05:59:44.193263 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 406/805] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 05:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 05:59:44.474208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0e25b2e0-dbeb-471c-8153-de1f50dec557 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:44.474820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0e25b2e0-dbeb-471c-8153-de1f50dec557 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:44.481460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e25b2e0-dbeb-471c-8153-de1f50dec557 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:44.481910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e25b2e0-dbeb-471c-8153-de1f50dec557 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:44.482691 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e25b2e0-dbeb-471c-8153-de1f50dec557 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:44.483126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e25b2e0-dbeb-471c-8153-de1f50dec557 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:44.617398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0e25b2e0-dbeb-471c-8153-de1f50dec557 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:44.624985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0e25b2e0-dbeb-471c-8153-de1f50dec557 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.154598 Jul 04 05:59:44.625560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 400/806] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:44 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:45.647671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a13002f3-cbb5-4c04-b74d-d276613aa0ce tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:45.648705 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a13002f3-cbb5-4c04-b74d-d276613aa0ce tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:45.659309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a13002f3-cbb5-4c04-b74d-d276613aa0ce tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:45.660082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a13002f3-cbb5-4c04-b74d-d276613aa0ce tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:45.661325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a13002f3-cbb5-4c04-b74d-d276613aa0ce tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:45.662006 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a13002f3-cbb5-4c04-b74d-d276613aa0ce tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:45.803572 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a13002f3-cbb5-4c04-b74d-d276613aa0ce tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:45.811293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a13002f3-cbb5-4c04-b74d-d276613aa0ce tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.171630 Jul 04 05:59:45.811866 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 407/807] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:45 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:46.832304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fddb2fda-73d1-46ea-9a77-6fd05f9ce5f4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:46.833322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fddb2fda-73d1-46ea-9a77-6fd05f9ce5f4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:46.843307 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fddb2fda-73d1-46ea-9a77-6fd05f9ce5f4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:46.843790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fddb2fda-73d1-46ea-9a77-6fd05f9ce5f4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:46.844561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fddb2fda-73d1-46ea-9a77-6fd05f9ce5f4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:46.844996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fddb2fda-73d1-46ea-9a77-6fd05f9ce5f4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:46.992650 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fddb2fda-73d1-46ea-9a77-6fd05f9ce5f4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:47.001058 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fddb2fda-73d1-46ea-9a77-6fd05f9ce5f4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.175133 Jul 04 05:59:47.001625 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 401/808] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:46 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:48.021974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1e0ca485-e52d-41ee-aa15-52dfe24796fa tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:48.022911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1e0ca485-e52d-41ee-aa15-52dfe24796fa tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:48.026509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=68 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:48.033184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e0ca485-e52d-41ee-aa15-52dfe24796fa tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:48.033629 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e0ca485-e52d-41ee-aa15-52dfe24796fa tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:48.034403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e0ca485-e52d-41ee-aa15-52dfe24796fa tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:48.034836 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e0ca485-e52d-41ee-aa15-52dfe24796fa tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:48.193716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1e0ca485-e52d-41ee-aa15-52dfe24796fa tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:48.201666 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1e0ca485-e52d-41ee-aa15-52dfe24796fa tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.186235 Jul 04 05:59:48.202267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 408/809] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:48 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:49.222151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c270e1fc-4ca2-49ee-8960-430359fc6afc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:49.223116 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c270e1fc-4ca2-49ee-8960-430359fc6afc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:49.233491 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c270e1fc-4ca2-49ee-8960-430359fc6afc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:49.233945 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c270e1fc-4ca2-49ee-8960-430359fc6afc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:49.234718 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c270e1fc-4ca2-49ee-8960-430359fc6afc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:49.235177 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c270e1fc-4ca2-49ee-8960-430359fc6afc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:49.390549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c270e1fc-4ca2-49ee-8960-430359fc6afc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:49.398144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c270e1fc-4ca2-49ee-8960-430359fc6afc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.182244 Jul 04 05:59:49.398683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 402/810] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:49 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:50.428096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-12ef475a-1723-4243-a6fa-220416adde0f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:50.428931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-12ef475a-1723-4243-a6fa-220416adde0f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:50.438255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12ef475a-1723-4243-a6fa-220416adde0f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:50.438690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12ef475a-1723-4243-a6fa-220416adde0f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:50.439490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12ef475a-1723-4243-a6fa-220416adde0f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:50.439919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12ef475a-1723-4243-a6fa-220416adde0f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:50.580117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-12ef475a-1723-4243-a6fa-220416adde0f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:50.590821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-12ef475a-1723-4243-a6fa-220416adde0f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.169138 Jul 04 05:59:50.591396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 409/811] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:50 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:51.609697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-133c7e97-a26b-419b-9437-a6ec44c425b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:51.610303 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-133c7e97-a26b-419b-9437-a6ec44c425b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:51.617276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-133c7e97-a26b-419b-9437-a6ec44c425b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:51.617727 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-133c7e97-a26b-419b-9437-a6ec44c425b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:51.618494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-133c7e97-a26b-419b-9437-a6ec44c425b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:51.618928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-133c7e97-a26b-419b-9437-a6ec44c425b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:51.752430 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-133c7e97-a26b-419b-9437-a6ec44c425b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:51.760054 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-133c7e97-a26b-419b-9437-a6ec44c425b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.155077 Jul 04 05:59:51.763658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 403/812] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:51 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:52.780102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d8a15c99-8027-4acc-a50f-967c68f13248 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:52.780615 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d8a15c99-8027-4acc-a50f-967c68f13248 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:52.787124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8a15c99-8027-4acc-a50f-967c68f13248 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:52.787589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8a15c99-8027-4acc-a50f-967c68f13248 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:52.788729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8a15c99-8027-4acc-a50f-967c68f13248 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:52.789160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8a15c99-8027-4acc-a50f-967c68f13248 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:52.923038 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d8a15c99-8027-4acc-a50f-967c68f13248 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:52.934398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d8a15c99-8027-4acc-a50f-967c68f13248 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.159940 Jul 04 05:59:52.935337 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 410/813] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:52 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:53.960159 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b6a75ce1-1cb7-495b-a852-ea733407de13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:53.961242 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b6a75ce1-1cb7-495b-a852-ea733407de13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:53.965109 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=56 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:53.974344 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6a75ce1-1cb7-495b-a852-ea733407de13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:53.975086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6a75ce1-1cb7-495b-a852-ea733407de13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:53.976383 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6a75ce1-1cb7-495b-a852-ea733407de13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:53.977100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6a75ce1-1cb7-495b-a852-ea733407de13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:54.115839 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b6a75ce1-1cb7-495b-a852-ea733407de13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:54.123608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b6a75ce1-1cb7-495b-a852-ea733407de13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.169793 Jul 04 05:59:54.124162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 404/814] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:53 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:55.144225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7d7c7cef-a417-404c-a4e9-b9ca73a45058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:55.144973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7d7c7cef-a417-404c-a4e9-b9ca73a45058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:55.154002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d7c7cef-a417-404c-a4e9-b9ca73a45058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:55.154608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d7c7cef-a417-404c-a4e9-b9ca73a45058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:55.155689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d7c7cef-a417-404c-a4e9-b9ca73a45058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:55.156266 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d7c7cef-a417-404c-a4e9-b9ca73a45058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:55.298708 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7d7c7cef-a417-404c-a4e9-b9ca73a45058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:55.310938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7d7c7cef-a417-404c-a4e9-b9ca73a45058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.171710 Jul 04 05:59:55.311700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 411/815] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:55 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:56.336289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e0f8d4d6-16f2-46e1-8c30-6bde47a20dd3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:56.337602 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e0f8d4d6-16f2-46e1-8c30-6bde47a20dd3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:56.345028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0f8d4d6-16f2-46e1-8c30-6bde47a20dd3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:56.345478 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0f8d4d6-16f2-46e1-8c30-6bde47a20dd3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:56.346235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0f8d4d6-16f2-46e1-8c30-6bde47a20dd3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:56.346666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0f8d4d6-16f2-46e1-8c30-6bde47a20dd3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:56.494772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0f8d4d6-16f2-46e1-8c30-6bde47a20dd3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:56.503213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e0f8d4d6-16f2-46e1-8c30-6bde47a20dd3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.173654 Jul 04 05:59:56.504110 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 405/816] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:56 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:57.528413 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-032a820f-450a-4634-9688-169b7975f459 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:57.529067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-032a820f-450a-4634-9688-169b7975f459 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:57.540315 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-032a820f-450a-4634-9688-169b7975f459 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:57.540934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-032a820f-450a-4634-9688-169b7975f459 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:57.542065 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-032a820f-450a-4634-9688-169b7975f459 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:57.542616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-032a820f-450a-4634-9688-169b7975f459 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:57.678343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-032a820f-450a-4634-9688-169b7975f459 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:57.686028 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-032a820f-450a-4634-9688-169b7975f459 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.164126 Jul 04 05:59:57.686582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 412/817] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:57 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:58.707096 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-81269399-e6e3-464b-8a55-1838dd39655f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:58.708086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-81269399-e6e3-464b-8a55-1838dd39655f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:58.719623 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81269399-e6e3-464b-8a55-1838dd39655f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:58.720283 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81269399-e6e3-464b-8a55-1838dd39655f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:58.721557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81269399-e6e3-464b-8a55-1838dd39655f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:58.722266 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81269399-e6e3-464b-8a55-1838dd39655f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:58.875111 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-81269399-e6e3-464b-8a55-1838dd39655f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 05:59:58.883127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-81269399-e6e3-464b-8a55-1838dd39655f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.182477 Jul 04 05:59:58.883740 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 406/818] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:58 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 05:59:59.904644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb82910a-67eb-4405-997c-afbbea46e0ef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 05:59:59.905671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bb82910a-67eb-4405-997c-afbbea46e0ef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 05:59:59.912560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb82910a-67eb-4405-997c-afbbea46e0ef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:59.913339 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb82910a-67eb-4405-997c-afbbea46e0ef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 05:59:59.914108 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb82910a-67eb-4405-997c-afbbea46e0ef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 05:59:59.914540 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb82910a-67eb-4405-997c-afbbea46e0ef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:00.042827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bb82910a-67eb-4405-997c-afbbea46e0ef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:00.050798 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bb82910a-67eb-4405-997c-afbbea46e0ef tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.153116 Jul 04 06:00:00.051438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 413/819] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 05:59:59 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:01.072024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-607046ca-c3f1-49d7-8962-572306fc4f0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:01.073022 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-607046ca-c3f1-49d7-8962-572306fc4f0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:01.084035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-607046ca-c3f1-49d7-8962-572306fc4f0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:01.084820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-607046ca-c3f1-49d7-8962-572306fc4f0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:01.086085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-607046ca-c3f1-49d7-8962-572306fc4f0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:01.086860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-607046ca-c3f1-49d7-8962-572306fc4f0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:01.219428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-607046ca-c3f1-49d7-8962-572306fc4f0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:01.228565 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-607046ca-c3f1-49d7-8962-572306fc4f0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.161438 Jul 04 06:00:01.229149 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 407/820] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:01 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:01.782707 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2a5fc04f-3343-4e41-9e91-8ff37286e1bb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:01.783587 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2a5fc04f-3343-4e41-9e91-8ff37286e1bb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:01.790863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a5fc04f-3343-4e41-9e91-8ff37286e1bb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:01.791335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a5fc04f-3343-4e41-9e91-8ff37286e1bb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:01.792093 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a5fc04f-3343-4e41-9e91-8ff37286e1bb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:01.792499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a5fc04f-3343-4e41-9e91-8ff37286e1bb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:01.821476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2a5fc04f-3343-4e41-9e91-8ff37286e1bb tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042726 Jul 04 06:00:01.822020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 414/821] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:01 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 06:00:01.889619 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-37e735e5-145b-4636-8ee1-c9c39680a93e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:01.890516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-37e735e5-145b-4636-8ee1-c9c39680a93e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:01.899527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37e735e5-145b-4636-8ee1-c9c39680a93e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:01.900122 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37e735e5-145b-4636-8ee1-c9c39680a93e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:01.901174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37e735e5-145b-4636-8ee1-c9c39680a93e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:01.901838 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37e735e5-145b-4636-8ee1-c9c39680a93e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:01.929438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-37e735e5-145b-4636-8ee1-c9c39680a93e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:00:02.008977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-37e735e5-145b-4636-8ee1-c9c39680a93e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 204 len: 0 microversion: 2.1 time: 0.125289 Jul 04 06:00:02.009601 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 408/822] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:00:01 2022] DELETE /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 06:00:02.018087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-81352e2c-2750-47e1-ba79-83c29b4363cf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:02.018720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-81352e2c-2750-47e1-ba79-83c29b4363cf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:02.024888 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81352e2c-2750-47e1-ba79-83c29b4363cf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:02.025332 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81352e2c-2750-47e1-ba79-83c29b4363cf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:02.026087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81352e2c-2750-47e1-ba79-83c29b4363cf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:02.026521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81352e2c-2750-47e1-ba79-83c29b4363cf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:02.159649 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-81352e2c-2750-47e1-ba79-83c29b4363cf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:02.168188 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-81352e2c-2750-47e1-ba79-83c29b4363cf tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1671 microversion: 2.1 time: 0.153979 Jul 04 06:00:02.168756 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 415/823] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:02 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:02.250467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab5e625b-684d-498c-b7e9-0b9b2022f34c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:02.251730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab5e625b-684d-498c-b7e9-0b9b2022f34c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:02.263791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5e625b-684d-498c-b7e9-0b9b2022f34c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:02.265050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5e625b-684d-498c-b7e9-0b9b2022f34c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:02.266393 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5e625b-684d-498c-b7e9-0b9b2022f34c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:02.267171 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5e625b-684d-498c-b7e9-0b9b2022f34c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:02.407677 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab5e625b-684d-498c-b7e9-0b9b2022f34c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:02.418302 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab5e625b-684d-498c-b7e9-0b9b2022f34c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.174709 Jul 04 06:00:02.419193 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 409/824] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:02 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:03.186134 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cb01243e-9975-40d9-89a7-87fe98e43d57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:03.186760 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cb01243e-9975-40d9-89a7-87fe98e43d57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:03.193478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb01243e-9975-40d9-89a7-87fe98e43d57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:03.193931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb01243e-9975-40d9-89a7-87fe98e43d57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:03.194691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb01243e-9975-40d9-89a7-87fe98e43d57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:03.195149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb01243e-9975-40d9-89a7-87fe98e43d57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:03.199205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:03.419060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cb01243e-9975-40d9-89a7-87fe98e43d57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:03.427015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cb01243e-9975-40d9-89a7-87fe98e43d57 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1671 microversion: 2.1 time: 0.244736 Jul 04 06:00:03.427846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 416/825] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:03 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1671 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:03.437215 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5880a3c8-1991-47a2-b010-806cd9990ded tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:03.438436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5880a3c8-1991-47a2-b010-806cd9990ded tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:03.445257 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5880a3c8-1991-47a2-b010-806cd9990ded tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:03.445707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5880a3c8-1991-47a2-b010-806cd9990ded tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:03.446480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5880a3c8-1991-47a2-b010-806cd9990ded tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:03.446913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5880a3c8-1991-47a2-b010-806cd9990ded tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:03.589507 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5880a3c8-1991-47a2-b010-806cd9990ded tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:03.597708 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5880a3c8-1991-47a2-b010-806cd9990ded tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.164828 Jul 04 06:00:03.598241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 410/826] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:03 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:04.080330 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-d85a522a-be16-4d96-8e6b-5822097b12b9 req-30171bdf-2bb6-453b-93ed-bf6fa591c386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9979d81a-1d93-423a-b99e-74434186140a", "name": "network-vif-deleted", "tag": "1156d5a0-a197-4c61-8b92-ca56849134a9"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:00:04.089523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d85a522a-be16-4d96-8e6b-5822097b12b9 req-30171bdf-2bb6-453b-93ed-bf6fa591c386 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:04.090064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d85a522a-be16-4d96-8e6b-5822097b12b9 req-30171bdf-2bb6-453b-93ed-bf6fa591c386 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:04.103125 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-d85a522a-be16-4d96-8e6b-5822097b12b9 req-30171bdf-2bb6-453b-93ed-bf6fa591c386 service nova] Creating event network-vif-deleted:1156d5a0-a197-4c61-8b92-ca56849134a9 for instance 9979d81a-1d93-423a-b99e-74434186140a on hv-cinder-79733 Jul 04 06:00:04.109204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-d85a522a-be16-4d96-8e6b-5822097b12b9 req-30171bdf-2bb6-453b-93ed-bf6fa591c386 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032485 Jul 04 06:00:04.110410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 417/827] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:00:04.445950 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4cfba392-62a4-4988-9455-c9f6f2359586 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:04.446553 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4cfba392-62a4-4988-9455-c9f6f2359586 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:04.453418 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cfba392-62a4-4988-9455-c9f6f2359586 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:04.453897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cfba392-62a4-4988-9455-c9f6f2359586 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:04.454698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cfba392-62a4-4988-9455-c9f6f2359586 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:04.455160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cfba392-62a4-4988-9455-c9f6f2359586 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:04.475269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:04.490378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cfba392-62a4-4988-9455-c9f6f2359586 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:04.490813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cfba392-62a4-4988-9455-c9f6f2359586 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:04.491280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-4cfba392-62a4-4988-9455-c9f6f2359586 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lazy-loading 'fault' on Instance uuid 9979d81a-1d93-423a-b99e-74434186140a {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:00:04.533573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4cfba392-62a4-4988-9455-c9f6f2359586 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:04.541439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4cfba392-62a4-4988-9455-c9f6f2359586 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 200 len: 1324 microversion: 2.1 time: 0.099291 Jul 04 06:00:04.542008 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 411/828] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:04 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 1324 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:04.614819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-95586a0b-2041-45bb-8e7d-5a598d4848bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:04.615975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-95586a0b-2041-45bb-8e7d-5a598d4848bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:04.621089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2b620ca-952d-400f-84c3-f45cada235c4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:04.621906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c2b620ca-952d-400f-84c3-f45cada235c4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:04.623112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95586a0b-2041-45bb-8e7d-5a598d4848bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:04.623583 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95586a0b-2041-45bb-8e7d-5a598d4848bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:04.624576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95586a0b-2041-45bb-8e7d-5a598d4848bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:04.625028 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95586a0b-2041-45bb-8e7d-5a598d4848bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:04.628450 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2b620ca-952d-400f-84c3-f45cada235c4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:04.628902 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2b620ca-952d-400f-84c3-f45cada235c4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:04.629689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2b620ca-952d-400f-84c3-f45cada235c4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:04.630169 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2b620ca-952d-400f-84c3-f45cada235c4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:04.653531 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2b620ca-952d-400f-84c3-f45cada235c4 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529/ips" status: 200 len: 151 microversion: 2.20 time: 0.036999 Jul 04 06:00:04.654356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 412/829] 10.222.0.42 () {60 vars in 1288 bytes} [Mon Jul 4 06:00:04 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 06:00:04.764499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-95586a0b-2041-45bb-8e7d-5a598d4848bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:04.772284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-95586a0b-2041-45bb-8e7d-5a598d4848bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.161713 Jul 04 06:00:04.773186 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 418/830] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:04 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:05.559161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-04bb2fe1-786d-4efd-bf45-004cf5a08866 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:05.559809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-04bb2fe1-786d-4efd-bf45-004cf5a08866 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:05.566734 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04bb2fe1-786d-4efd-bf45-004cf5a08866 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:05.567178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04bb2fe1-786d-4efd-bf45-004cf5a08866 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:05.568004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04bb2fe1-786d-4efd-bf45-004cf5a08866 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:05.568436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04bb2fe1-786d-4efd-bf45-004cf5a08866 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:05.582090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-04bb2fe1-786d-4efd-bf45-004cf5a08866 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] HTTP exception thrown: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-04bb2fe1-786d-4efd-bf45-004cf5a08866 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Request method failure captured: Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a HTTP/1.1 Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoCEUy_tkDjUbVKcexapYDAsm40eALAF_dR72XCRiPOAjjY_kvltuR8PCLFjH0f4aNu7xrSw_7JDtTHQcBWxoA1U4NVcaSanOU_o948upgIv2ysLLAABEBrFpimbso2wYYcX-Syirc3zdf6h3irlfBmfus4yp-93Cx-MzRohzZ4xanY Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:00:05.583837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 32703b5451cf48b09966a7412b747099 Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:00:05.585448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '9979d81a-1d93-423a-b99e-74434186140a'} Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:00:05.586461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:00:05.588192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:00:05.589620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-04bb2fe1-786d-4efd-bf45-004cf5a08866 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Returning 404 to user: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:00:05.589620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-04bb2fe1-786d-4efd-bf45-004cf5a08866 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 404 len: 111 microversion: 2.1 time: 0.030006 Jul 04 06:00:05.589620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 413/831] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:05 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:00:05.594132 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e4ac1d4b-2097-4368-93db-ba7b51e28e8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '.version_select at 0x7f20476864c0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:05.617605 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e4ac1d4b-2097-4368-93db-ba7b51e28e8c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-108030197" status: 202 len: 0 microversion: 2.1 time: 0.027361 Jul 04 06:00:05.618312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 419/832] 10.222.0.42 () {58 vars in 1217 bytes} [Mon Jul 4 06:00:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-108030197 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:00:05.790534 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-27faada7-22b8-41b2-91ac-7a86d2f54670 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:05.790942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-27faada7-22b8-41b2-91ac-7a86d2f54670 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:05.797541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27faada7-22b8-41b2-91ac-7a86d2f54670 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:05.797994 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27faada7-22b8-41b2-91ac-7a86d2f54670 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:05.798765 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27faada7-22b8-41b2-91ac-7a86d2f54670 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:05.799202 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27faada7-22b8-41b2-91ac-7a86d2f54670 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:06.035482 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-27faada7-22b8-41b2-91ac-7a86d2f54670 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:06.043389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-27faada7-22b8-41b2-91ac-7a86d2f54670 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.257221 Jul 04 06:00:06.043937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 414/833] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:05 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:06.597372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-62b8a83b-ebb2-47c0-b61f-c9b36995a332 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Action: 'create', calling method: .version_select at 0x7f2047531b80>, body: {"keypair": {"name": "tempest-keypair-363545843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGs750WZGg2S5GcYpuRALcjTFh9jdleEFsTtGOk17XG8wkb7dkLCrmFr20PXs/I6USo7w7OaiHhVkxrp54RAWydl8n7Vq7PDK/L2tsYbgS8eQMuyn6KIlrZ0iwgRpQfdw=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:00:06.613051 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-62b8a83b-ebb2-47c0-b61f-c9b36995a332 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Getting quotas for project bdd96113d4ef451d9ffc81c03c6ea70e. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 06:00:06.617358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-62b8a83b-ebb2-47c0-b61f-c9b36995a332 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Getting quotas for user 32703b5451cf48b09966a7412b747099 and project bdd96113d4ef451d9ffc81c03c6ea70e. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 06:00:06.643637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-62b8a83b-ebb2-47c0-b61f-c9b36995a332 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051279 Jul 04 06:00:06.644254 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 420/834] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jul 4 06:00:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:07.060943 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d09652a1-8db8-4fe2-aa75-c69d8ec8fdf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:07.062208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d09652a1-8db8-4fe2-aa75-c69d8ec8fdf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:07.070508 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d09652a1-8db8-4fe2-aa75-c69d8ec8fdf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:07.071158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d09652a1-8db8-4fe2-aa75-c69d8ec8fdf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:07.071995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d09652a1-8db8-4fe2-aa75-c69d8ec8fdf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:07.072427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d09652a1-8db8-4fe2-aa75-c69d8ec8fdf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:07.294300 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d09652a1-8db8-4fe2-aa75-c69d8ec8fdf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:07.302406 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d09652a1-8db8-4fe2-aa75-c69d8ec8fdf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.245295 Jul 04 06:00:07.303230 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 415/835] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:07 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:08.053181 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-152459355", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f5266ef-05a5-42cb-ab01-a1f99eea484b"}], "security_groups": [{"name": "tempest-securitygroup--706235620"}], "key_name": "tempest-keypair-363545843", "user_data": "}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:00:08.158597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] validate_networks() for [('8f5266ef-05a5-42cb-ab01-a1f99eea484b', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 06:00:08.319825 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7f64e5a5-c883-4612-bca0-e3665ec5040a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:08.320498 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7f64e5a5-c883-4612-bca0-e3665ec5040a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:08.327338 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f64e5a5-c883-4612-bca0-e3665ec5040a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:08.328476 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f64e5a5-c883-4612-bca0-e3665ec5040a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:08.329575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f64e5a5-c883-4612-bca0-e3665ec5040a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:08.330092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f64e5a5-c883-4612-bca0-e3665ec5040a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:08.473716 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7f64e5a5-c883-4612-bca0-e3665ec5040a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:08.481055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7f64e5a5-c883-4612-bca0-e3665ec5040a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.165179 Jul 04 06:00:08.481587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 416/836] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:08 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:08.836186 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 06:00:08.836957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 06:00:08.837730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 06:00:08.838402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 06:00:08.839075 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 06:00:08.850162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:08.850602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:08.851424 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:08.851849 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:08.868770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Getting quotas for project bdd96113d4ef451d9ffc81c03c6ea70e. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 06:00:08.873150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Getting quotas for user 32703b5451cf48b09966a7412b747099 and project bdd96113d4ef451d9ffc81c03c6ea70e. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 06:00:08.885328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 06:00:08.887590 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 06:00:08.949167 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e0353b55-4c42-4566-9b9d-4277c4e9dd32 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.900264 Jul 04 06:00:08.950125 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 421/837] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 06:00:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 06:00:08.960381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-09478d63-5eb6-40bb-ac95-aecdc1e4305a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:08.961069 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-09478d63-5eb6-40bb-ac95-aecdc1e4305a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:09.018239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-09478d63-5eb6-40bb-ac95-aecdc1e4305a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:09.024897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-09478d63-5eb6-40bb-ac95-aecdc1e4305a tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1236 microversion: 2.1 time: 0.068427 Jul 04 06:00:09.025465 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 417/838] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:08 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:09.498748 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-72814e0d-429b-47a9-adee-d42a7c81f6f3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:09.499979 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-72814e0d-429b-47a9-adee-d42a7c81f6f3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:09.507641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72814e0d-429b-47a9-adee-d42a7c81f6f3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:09.508113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72814e0d-429b-47a9-adee-d42a7c81f6f3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:09.508898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72814e0d-429b-47a9-adee-d42a7c81f6f3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:09.509348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72814e0d-429b-47a9-adee-d42a7c81f6f3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:09.642977 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-72814e0d-429b-47a9-adee-d42a7c81f6f3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:09.653187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-72814e0d-429b-47a9-adee-d42a7c81f6f3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.158643 Jul 04 06:00:09.653917 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 422/839] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:09 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:10.043228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-225a5529-68e5-46d3-9117-730c3b2e3a49 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:10.044543 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-225a5529-68e5-46d3-9117-730c3b2e3a49 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:10.051481 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-225a5529-68e5-46d3-9117-730c3b2e3a49 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:10.051921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-225a5529-68e5-46d3-9117-730c3b2e3a49 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:10.053001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-225a5529-68e5-46d3-9117-730c3b2e3a49 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:10.053536 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-225a5529-68e5-46d3-9117-730c3b2e3a49 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:10.122706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-225a5529-68e5-46d3-9117-730c3b2e3a49 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:10.130763 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-225a5529-68e5-46d3-9117-730c3b2e3a49 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1296 microversion: 2.1 time: 0.091873 Jul 04 06:00:10.140658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 418/840] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:10 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:10.670271 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-829655c1-f23c-482c-9584-79eeab571238 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:10.671160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-829655c1-f23c-482c-9584-79eeab571238 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:10.677993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-829655c1-f23c-482c-9584-79eeab571238 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:10.678439 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-829655c1-f23c-482c-9584-79eeab571238 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:10.679182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-829655c1-f23c-482c-9584-79eeab571238 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:10.679850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-829655c1-f23c-482c-9584-79eeab571238 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:10.915650 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-829655c1-f23c-482c-9584-79eeab571238 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:10.923498 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-829655c1-f23c-482c-9584-79eeab571238 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.257217 Jul 04 06:00:10.924070 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 423/841] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:10 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:11.148347 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d346b396-50b4-4fbe-837d-1e866a596930 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:11.149054 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d346b396-50b4-4fbe-837d-1e866a596930 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:11.156048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d346b396-50b4-4fbe-837d-1e866a596930 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:11.156567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d346b396-50b4-4fbe-837d-1e866a596930 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:11.157435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d346b396-50b4-4fbe-837d-1e866a596930 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:11.157981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d346b396-50b4-4fbe-837d-1e866a596930 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:11.318239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d346b396-50b4-4fbe-837d-1e866a596930 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:11.326318 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d346b396-50b4-4fbe-837d-1e866a596930 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1361 microversion: 2.1 time: 0.181779 Jul 04 06:00:11.327087 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 419/842] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:11 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:00:11.422344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-d659b0f5-d0b7-4f2a-b532-51779f747bd1 req-f18dce5b-19cb-45e8-9b8c-d343f9d3e741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c1202bc-e2f9-4a89-b2da-819b3132f5bd", "tag": "e17f2251-ccbb-45d3-ba0a-ca2b1e84120b"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:00:11.431431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d659b0f5-d0b7-4f2a-b532-51779f747bd1 req-f18dce5b-19cb-45e8-9b8c-d343f9d3e741 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:11.432165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d659b0f5-d0b7-4f2a-b532-51779f747bd1 req-f18dce5b-19cb-45e8-9b8c-d343f9d3e741 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:11.447435 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-d659b0f5-d0b7-4f2a-b532-51779f747bd1 req-f18dce5b-19cb-45e8-9b8c-d343f9d3e741 service nova] Creating event network-changed:e17f2251-ccbb-45d3-ba0a-ca2b1e84120b for instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd on hv-cinder-79733 Jul 04 06:00:11.460848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-d659b0f5-d0b7-4f2a-b532-51779f747bd1 req-f18dce5b-19cb-45e8-9b8c-d343f9d3e741 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042101 Jul 04 06:00:11.461538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 424/843] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:11.941171 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-896fb9a9-1b72-43df-8fc7-470f16ca0e0d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:11.941672 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-896fb9a9-1b72-43df-8fc7-470f16ca0e0d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:11.948268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-896fb9a9-1b72-43df-8fc7-470f16ca0e0d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:11.948729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-896fb9a9-1b72-43df-8fc7-470f16ca0e0d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:11.949487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-896fb9a9-1b72-43df-8fc7-470f16ca0e0d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:11.949914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-896fb9a9-1b72-43df-8fc7-470f16ca0e0d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:12.101070 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-896fb9a9-1b72-43df-8fc7-470f16ca0e0d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:12.109174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-896fb9a9-1b72-43df-8fc7-470f16ca0e0d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.171960 Jul 04 06:00:12.109739 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 420/844] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:11 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:12.344797 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-23a914d6-f36f-41b3-9dbe-045080771a00 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:12.345483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-23a914d6-f36f-41b3-9dbe-045080771a00 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:12.352332 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23a914d6-f36f-41b3-9dbe-045080771a00 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:12.352777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23a914d6-f36f-41b3-9dbe-045080771a00 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:12.353543 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23a914d6-f36f-41b3-9dbe-045080771a00 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:12.353954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23a914d6-f36f-41b3-9dbe-045080771a00 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:12.505535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-23a914d6-f36f-41b3-9dbe-045080771a00 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:12.515808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-23a914d6-f36f-41b3-9dbe-045080771a00 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1361 microversion: 2.1 time: 0.175148 Jul 04 06:00:12.516626 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 425/845] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:12 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:13.126719 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a0ccaf7-c72e-4bd5-9155-b9e518d30ba6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:13.127439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a0ccaf7-c72e-4bd5-9155-b9e518d30ba6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:13.135071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a0ccaf7-c72e-4bd5-9155-b9e518d30ba6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:13.135547 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a0ccaf7-c72e-4bd5-9155-b9e518d30ba6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:13.136319 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a0ccaf7-c72e-4bd5-9155-b9e518d30ba6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:13.136751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a0ccaf7-c72e-4bd5-9155-b9e518d30ba6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:13.278270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a0ccaf7-c72e-4bd5-9155-b9e518d30ba6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:13.285997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a0ccaf7-c72e-4bd5-9155-b9e518d30ba6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.163760 Jul 04 06:00:13.286572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 421/846] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:13 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:13.538739 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a85472cc-688b-4547-85c0-78354e33fc6b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:13.539402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a85472cc-688b-4547-85c0-78354e33fc6b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:13.546789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a85472cc-688b-4547-85c0-78354e33fc6b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:13.547267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a85472cc-688b-4547-85c0-78354e33fc6b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:13.548074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a85472cc-688b-4547-85c0-78354e33fc6b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:13.548499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a85472cc-688b-4547-85c0-78354e33fc6b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:13.682634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a85472cc-688b-4547-85c0-78354e33fc6b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:13.690487 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a85472cc-688b-4547-85c0-78354e33fc6b tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1361 microversion: 2.1 time: 0.156029 Jul 04 06:00:13.691066 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 426/847] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:13 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:14.311194 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-17498d3d-4600-4912-88f3-fa7d1266bee9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:14.312294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-17498d3d-4600-4912-88f3-fa7d1266bee9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:14.323428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17498d3d-4600-4912-88f3-fa7d1266bee9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:14.324190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17498d3d-4600-4912-88f3-fa7d1266bee9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:14.325457 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17498d3d-4600-4912-88f3-fa7d1266bee9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:14.326178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17498d3d-4600-4912-88f3-fa7d1266bee9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:14.471412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-17498d3d-4600-4912-88f3-fa7d1266bee9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:14.479284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-17498d3d-4600-4912-88f3-fa7d1266bee9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.174607 Jul 04 06:00:14.479820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 422/848] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:14 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:14.716202 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7c1bfb36-eba7-4706-b6c1-6b994753e2b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:14.717061 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7c1bfb36-eba7-4706-b6c1-6b994753e2b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:14.724410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c1bfb36-eba7-4706-b6c1-6b994753e2b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:14.724849 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c1bfb36-eba7-4706-b6c1-6b994753e2b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:14.725606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c1bfb36-eba7-4706-b6c1-6b994753e2b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:14.726008 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c1bfb36-eba7-4706-b6c1-6b994753e2b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:14.866220 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7c1bfb36-eba7-4706-b6c1-6b994753e2b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:14.874693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7c1bfb36-eba7-4706-b6c1-6b994753e2b1 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1361 microversion: 2.1 time: 0.165461 Jul 04 06:00:14.875237 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 427/849] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:14 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:15.500895 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1e79928d-2997-4417-a3a4-f5ced4731785 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:15.501474 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1e79928d-2997-4417-a3a4-f5ced4731785 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:15.508980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e79928d-2997-4417-a3a4-f5ced4731785 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:15.509457 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e79928d-2997-4417-a3a4-f5ced4731785 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:15.510289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e79928d-2997-4417-a3a4-f5ced4731785 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:15.510661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e79928d-2997-4417-a3a4-f5ced4731785 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:15.648855 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1e79928d-2997-4417-a3a4-f5ced4731785 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:15.656486 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1e79928d-2997-4417-a3a4-f5ced4731785 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.161552 Jul 04 06:00:15.657048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 423/850] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:15 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:15.899353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0cf15a9-626a-44ae-ac18-c3c80e6e55a7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:15.900085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0cf15a9-626a-44ae-ac18-c3c80e6e55a7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:15.909062 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0cf15a9-626a-44ae-ac18-c3c80e6e55a7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:15.909691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0cf15a9-626a-44ae-ac18-c3c80e6e55a7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:15.910803 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0cf15a9-626a-44ae-ac18-c3c80e6e55a7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:15.911470 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0cf15a9-626a-44ae-ac18-c3c80e6e55a7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:16.050240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f0cf15a9-626a-44ae-ac18-c3c80e6e55a7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:16.058063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0cf15a9-626a-44ae-ac18-c3c80e6e55a7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1361 microversion: 2.1 time: 0.164530 Jul 04 06:00:16.058644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 428/851] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:15 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:16.684458 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0b0d2c30-3e3b-4a2a-a9cb-076efd494cee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:16.685028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0b0d2c30-3e3b-4a2a-a9cb-076efd494cee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:16.695099 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b0d2c30-3e3b-4a2a-a9cb-076efd494cee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:16.695665 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b0d2c30-3e3b-4a2a-a9cb-076efd494cee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:16.696760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b0d2c30-3e3b-4a2a-a9cb-076efd494cee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:16.697312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b0d2c30-3e3b-4a2a-a9cb-076efd494cee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:16.834593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0b0d2c30-3e3b-4a2a-a9cb-076efd494cee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:16.842468 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0b0d2c30-3e3b-4a2a-a9cb-076efd494cee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.164542 Jul 04 06:00:16.843043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 424/852] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:16 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:17.074228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-488e5100-a558-4a44-8714-1de7f0009cd4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:17.075535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-488e5100-a558-4a44-8714-1de7f0009cd4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:17.081859 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-488e5100-a558-4a44-8714-1de7f0009cd4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:17.082279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-488e5100-a558-4a44-8714-1de7f0009cd4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:17.083056 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-488e5100-a558-4a44-8714-1de7f0009cd4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:17.083514 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-488e5100-a558-4a44-8714-1de7f0009cd4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:17.220214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-488e5100-a558-4a44-8714-1de7f0009cd4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:17.229013 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-488e5100-a558-4a44-8714-1de7f0009cd4 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1361 microversion: 2.1 time: 0.158521 Jul 04 06:00:17.229583 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 429/853] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:17 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:17.863686 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d73a3d13-d56a-4c11-94b7-0bdb57d1d4c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:17.864507 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d73a3d13-d56a-4c11-94b7-0bdb57d1d4c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:17.875597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d73a3d13-d56a-4c11-94b7-0bdb57d1d4c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:17.876052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d73a3d13-d56a-4c11-94b7-0bdb57d1d4c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:17.876817 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d73a3d13-d56a-4c11-94b7-0bdb57d1d4c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:17.877250 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d73a3d13-d56a-4c11-94b7-0bdb57d1d4c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:18.024580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d73a3d13-d56a-4c11-94b7-0bdb57d1d4c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:18.032624 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d73a3d13-d56a-4c11-94b7-0bdb57d1d4c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.175694 Jul 04 06:00:18.033199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 425/854] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:17 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:00:18.248904 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e7445bb-5d60-4e0c-a441-f4ea966de02c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:18.250131 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e7445bb-5d60-4e0c-a441-f4ea966de02c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:18.256846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e7445bb-5d60-4e0c-a441-f4ea966de02c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:18.257475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e7445bb-5d60-4e0c-a441-f4ea966de02c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:18.258254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e7445bb-5d60-4e0c-a441-f4ea966de02c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:18.258877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e7445bb-5d60-4e0c-a441-f4ea966de02c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:18.304266 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-313472fe-fcad-4c7c-8b1f-11ee7db5ec68 req-aa4ec39f-db1b-4163-a0b8-3dbf9e776c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c1202bc-e2f9-4a89-b2da-819b3132f5bd", "name": "network-vif-plugged", "status": "completed", "tag": "e17f2251-ccbb-45d3-ba0a-ca2b1e84120b"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:00:18.307893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:18.313830 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-313472fe-fcad-4c7c-8b1f-11ee7db5ec68 req-aa4ec39f-db1b-4163-a0b8-3dbf9e776c4d service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:18.314273 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-313472fe-fcad-4c7c-8b1f-11ee7db5ec68 req-aa4ec39f-db1b-4163-a0b8-3dbf9e776c4d service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:18.326675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-313472fe-fcad-4c7c-8b1f-11ee7db5ec68 req-aa4ec39f-db1b-4163-a0b8-3dbf9e776c4d service nova] Creating event network-vif-plugged:e17f2251-ccbb-45d3-ba0a-ca2b1e84120b for instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd on hv-cinder-79733 Jul 04 06:00:18.332024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-313472fe-fcad-4c7c-8b1f-11ee7db5ec68 req-aa4ec39f-db1b-4163-a0b8-3dbf9e776c4d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103682 Jul 04 06:00:18.332624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 430/855] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:18.402828 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6e7445bb-5d60-4e0c-a441-f4ea966de02c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:18.410656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e7445bb-5d60-4e0c-a441-f4ea966de02c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1361 microversion: 2.1 time: 0.168172 Jul 04 06:00:18.411239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 426/856] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:18 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:00:19.048733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:19.049931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=10 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:19.057074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2ef34eef-c324-4759-9ce8-6fe8d3b1b434 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:19.058197 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2ef34eef-c324-4759-9ce8-6fe8d3b1b434 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:19.067544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ef34eef-c324-4759-9ce8-6fe8d3b1b434 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:19.067991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ef34eef-c324-4759-9ce8-6fe8d3b1b434 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:19.068742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ef34eef-c324-4759-9ce8-6fe8d3b1b434 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:19.069167 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ef34eef-c324-4759-9ce8-6fe8d3b1b434 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:19.209804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2ef34eef-c324-4759-9ce8-6fe8d3b1b434 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:19.217648 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2ef34eef-c324-4759-9ce8-6fe8d3b1b434 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.170721 Jul 04 06:00:19.218206 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 431/857] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:19 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:19.428407 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b487bdb1-72d9-4348-934b-c36b6bb9580e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:19.429026 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b487bdb1-72d9-4348-934b-c36b6bb9580e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:19.431443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:19.437023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b487bdb1-72d9-4348-934b-c36b6bb9580e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:19.437475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b487bdb1-72d9-4348-934b-c36b6bb9580e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:19.438243 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b487bdb1-72d9-4348-934b-c36b6bb9580e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:19.438680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b487bdb1-72d9-4348-934b-c36b6bb9580e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:19.574170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b487bdb1-72d9-4348-934b-c36b6bb9580e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:19.582069 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b487bdb1-72d9-4348-934b-c36b6bb9580e tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1361 microversion: 2.1 time: 0.157540 Jul 04 06:00:19.582610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 427/858] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:19 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:20.147223 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-caf3c46d-2dbc-438f-8447-231edf2ab74c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:20.147797 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-caf3c46d-2dbc-438f-8447-231edf2ab74c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:20.154480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caf3c46d-2dbc-438f-8447-231edf2ab74c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:20.154927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caf3c46d-2dbc-438f-8447-231edf2ab74c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:20.155722 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caf3c46d-2dbc-438f-8447-231edf2ab74c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:20.156153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caf3c46d-2dbc-438f-8447-231edf2ab74c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:20.234865 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-33c14b28-72c0-4be9-b3c2-e7ba351f91b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:20.236095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-33c14b28-72c0-4be9-b3c2-e7ba351f91b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:20.239670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-caf3c46d-2dbc-438f-8447-231edf2ab74c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lazy-loading 'services' on Instance uuid 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:00:20.244534 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33c14b28-72c0-4be9-b3c2-e7ba351f91b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:20.244534 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33c14b28-72c0-4be9-b3c2-e7ba351f91b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:20.244779 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33c14b28-72c0-4be9-b3c2-e7ba351f91b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:20.245160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33c14b28-72c0-4be9-b3c2-e7ba351f91b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:20.347706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-caf3c46d-2dbc-438f-8447-231edf2ab74c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments/894fb4af-f3ce-4764-814d-ad6e790e7fa5" status: 202 len: 0 microversion: 2.1 time: 0.204228 Jul 04 06:00:20.348446 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 432/859] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jul 4 06:00:20 2022] DELETE /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments/894fb4af-f3ce-4764-814d-ad6e790e7fa5 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:00:20.357623 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5ff971d-5030-42dd-ad29-75e9f419d5b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:20.358830 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5ff971d-5030-42dd-ad29-75e9f419d5b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:20.365591 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5ff971d-5030-42dd-ad29-75e9f419d5b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:20.366109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5ff971d-5030-42dd-ad29-75e9f419d5b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:20.367311 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5ff971d-5030-42dd-ad29-75e9f419d5b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:20.367813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5ff971d-5030-42dd-ad29-75e9f419d5b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:20.382003 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-33c14b28-72c0-4be9-b3c2-e7ba351f91b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:20.389478 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-33c14b28-72c0-4be9-b3c2-e7ba351f91b9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.158458 Jul 04 06:00:20.390046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 428/860] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:20 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:00:20.407960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5ff971d-5030-42dd-ad29-75e9f419d5b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054679 Jul 04 06:00:20.408522 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 433/861] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:20 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:00:20.601485 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5db7dacf-3a50-423c-96c5-0545a9aed2a6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:20.602141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5db7dacf-3a50-423c-96c5-0545a9aed2a6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:20.610345 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5db7dacf-3a50-423c-96c5-0545a9aed2a6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:20.610872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5db7dacf-3a50-423c-96c5-0545a9aed2a6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:20.611849 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5db7dacf-3a50-423c-96c5-0545a9aed2a6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:20.612357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5db7dacf-3a50-423c-96c5-0545a9aed2a6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:20.764778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5db7dacf-3a50-423c-96c5-0545a9aed2a6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:20.768431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:20.772949 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5db7dacf-3a50-423c-96c5-0545a9aed2a6 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1548 microversion: 2.1 time: 0.176234 Jul 04 06:00:20.773495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 429/862] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:20 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:20.789957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-00738f35-cc0e-4c72-983d-d7d4a0c8ccc5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:20.790450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-00738f35-cc0e-4c72-983d-d7d4a0c8ccc5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:20.796634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00738f35-cc0e-4c72-983d-d7d4a0c8ccc5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:20.797116 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00738f35-cc0e-4c72-983d-d7d4a0c8ccc5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:20.797874 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00738f35-cc0e-4c72-983d-d7d4a0c8ccc5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:20.798307 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00738f35-cc0e-4c72-983d-d7d4a0c8ccc5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:20.877119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-00738f35-cc0e-4c72-983d-d7d4a0c8ccc5 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091421 Jul 04 06:00:20.877777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 434/863] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jul 4 06:00:20 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:21.406188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c69c3b6-0b70-4d82-83d3-8a8ae7214449 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:21.406798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9c69c3b6-0b70-4d82-83d3-8a8ae7214449 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:21.413994 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c69c3b6-0b70-4d82-83d3-8a8ae7214449 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:21.414680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c69c3b6-0b70-4d82-83d3-8a8ae7214449 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:21.415497 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c69c3b6-0b70-4d82-83d3-8a8ae7214449 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:21.415936 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c69c3b6-0b70-4d82-83d3-8a8ae7214449 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:21.419356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fe523a9f-7e9e-44ee-87a7-0473615c1737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:21.421019 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fe523a9f-7e9e-44ee-87a7-0473615c1737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:21.427697 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe523a9f-7e9e-44ee-87a7-0473615c1737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:21.428141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe523a9f-7e9e-44ee-87a7-0473615c1737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:21.428911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe523a9f-7e9e-44ee-87a7-0473615c1737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:21.429307 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe523a9f-7e9e-44ee-87a7-0473615c1737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:21.461653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fe523a9f-7e9e-44ee-87a7-0473615c1737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Jul 04 06:00:21.462329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 435/864] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:21.683301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9c69c3b6-0b70-4d82-83d3-8a8ae7214449 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:21.691351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9c69c3b6-0b70-4d82-83d3-8a8ae7214449 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.289102 Jul 04 06:00:21.691928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 430/865] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:21 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:21.929951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-786696c7-ca0b-45a7-acaa-6839488ed856 req-4bd458c6-5fdc-4c74-8b8d-4b2bd2b6438f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c1202bc-e2f9-4a89-b2da-819b3132f5bd", "tag": "e17f2251-ccbb-45d3-ba0a-ca2b1e84120b"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:00:21.938239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-786696c7-ca0b-45a7-acaa-6839488ed856 req-4bd458c6-5fdc-4c74-8b8d-4b2bd2b6438f service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:21.938681 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-786696c7-ca0b-45a7-acaa-6839488ed856 req-4bd458c6-5fdc-4c74-8b8d-4b2bd2b6438f service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:21.951866 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-786696c7-ca0b-45a7-acaa-6839488ed856 req-4bd458c6-5fdc-4c74-8b8d-4b2bd2b6438f service nova] Creating event network-changed:e17f2251-ccbb-45d3-ba0a-ca2b1e84120b for instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd on hv-cinder-79733 Jul 04 06:00:21.956910 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-786696c7-ca0b-45a7-acaa-6839488ed856 req-4bd458c6-5fdc-4c74-8b8d-4b2bd2b6438f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088174 Jul 04 06:00:21.957532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 436/866] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:00:22.474660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dc56d795-cb2d-4354-ac9e-7a980b2d630b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:22.476173 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dc56d795-cb2d-4354-ac9e-7a980b2d630b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:22.482857 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc56d795-cb2d-4354-ac9e-7a980b2d630b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:22.483473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc56d795-cb2d-4354-ac9e-7a980b2d630b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:22.484231 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc56d795-cb2d-4354-ac9e-7a980b2d630b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:22.485065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc56d795-cb2d-4354-ac9e-7a980b2d630b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:22.520624 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dc56d795-cb2d-4354-ac9e-7a980b2d630b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050949 Jul 04 06:00:22.521217 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 431/867] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:22.709902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1917c246-94a1-4e87-b8be-eab0bf1ac503 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:22.710569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1917c246-94a1-4e87-b8be-eab0bf1ac503 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:22.717231 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1917c246-94a1-4e87-b8be-eab0bf1ac503 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:22.717678 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1917c246-94a1-4e87-b8be-eab0bf1ac503 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:22.718508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1917c246-94a1-4e87-b8be-eab0bf1ac503 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:22.718948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1917c246-94a1-4e87-b8be-eab0bf1ac503 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:22.857491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1917c246-94a1-4e87-b8be-eab0bf1ac503 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:22.861375 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:22.869496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1917c246-94a1-4e87-b8be-eab0bf1ac503 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.164728 Jul 04 06:00:22.870415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 437/868] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:22 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:23.535848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f21fa242-b7b7-46bb-aad9-60654f755ba3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:23.536781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f21fa242-b7b7-46bb-aad9-60654f755ba3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:23.544362 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f21fa242-b7b7-46bb-aad9-60654f755ba3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:23.544810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f21fa242-b7b7-46bb-aad9-60654f755ba3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:23.545544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f21fa242-b7b7-46bb-aad9-60654f755ba3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:23.546010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f21fa242-b7b7-46bb-aad9-60654f755ba3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:23.576898 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f21fa242-b7b7-46bb-aad9-60654f755ba3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047054 Jul 04 06:00:23.577462 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 432/869] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:23.891324 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1de9ebed-e258-4e5a-94cd-860496cbd464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:23.892325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1de9ebed-e258-4e5a-94cd-860496cbd464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:23.900140 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1de9ebed-e258-4e5a-94cd-860496cbd464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:23.900590 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1de9ebed-e258-4e5a-94cd-860496cbd464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:23.901314 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1de9ebed-e258-4e5a-94cd-860496cbd464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:23.901755 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1de9ebed-e258-4e5a-94cd-860496cbd464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:24.037644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1de9ebed-e258-4e5a-94cd-860496cbd464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:24.048773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1de9ebed-e258-4e5a-94cd-860496cbd464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.164159 Jul 04 06:00:24.049536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 438/870] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:23 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:24.592515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92cfcdae-93f4-47b7-959c-1843e0519ab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:24.594205 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92cfcdae-93f4-47b7-959c-1843e0519ab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:24.607763 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:24.615279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92cfcdae-93f4-47b7-959c-1843e0519ab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:24.615750 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92cfcdae-93f4-47b7-959c-1843e0519ab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:24.616885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92cfcdae-93f4-47b7-959c-1843e0519ab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:24.617419 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92cfcdae-93f4-47b7-959c-1843e0519ab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:24.656740 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92cfcdae-93f4-47b7-959c-1843e0519ab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071121 Jul 04 06:00:24.657290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 433/871] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:25.068396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-00388f76-7a01-4d46-9b0f-f936828b26da tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:25.069315 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-00388f76-7a01-4d46-9b0f-f936828b26da tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:25.079181 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00388f76-7a01-4d46-9b0f-f936828b26da tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:25.079878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00388f76-7a01-4d46-9b0f-f936828b26da tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:25.081039 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00388f76-7a01-4d46-9b0f-f936828b26da tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:25.081686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00388f76-7a01-4d46-9b0f-f936828b26da tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:25.218730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-00388f76-7a01-4d46-9b0f-f936828b26da tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:25.227439 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-00388f76-7a01-4d46-9b0f-f936828b26da tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.164886 Jul 04 06:00:25.227977 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 439/872] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:25 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:25.669148 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d54004f8-15c0-4df2-8af3-ad96bd9695e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:25.670110 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d54004f8-15c0-4df2-8af3-ad96bd9695e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:25.677133 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d54004f8-15c0-4df2-8af3-ad96bd9695e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:25.677584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d54004f8-15c0-4df2-8af3-ad96bd9695e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:25.678359 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d54004f8-15c0-4df2-8af3-ad96bd9695e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:25.678797 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d54004f8-15c0-4df2-8af3-ad96bd9695e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:25.710524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d54004f8-15c0-4df2-8af3-ad96bd9695e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045410 Jul 04 06:00:25.711093 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 434/873] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:26.246253 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4d72689e-76f6-44a3-9bf4-f602785a1ad8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:26.247300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4d72689e-76f6-44a3-9bf4-f602785a1ad8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:26.256989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d72689e-76f6-44a3-9bf4-f602785a1ad8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:26.257544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d72689e-76f6-44a3-9bf4-f602785a1ad8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:26.258638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d72689e-76f6-44a3-9bf4-f602785a1ad8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:26.259298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d72689e-76f6-44a3-9bf4-f602785a1ad8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:26.400029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4d72689e-76f6-44a3-9bf4-f602785a1ad8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:26.408088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4d72689e-76f6-44a3-9bf4-f602785a1ad8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.167408 Jul 04 06:00:26.408704 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 440/874] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:26 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:26.722364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c7701d22-c866-4679-8a0f-b3dc6fed2b5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:26.723289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c7701d22-c866-4679-8a0f-b3dc6fed2b5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:26.730524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7701d22-c866-4679-8a0f-b3dc6fed2b5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:26.730981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7701d22-c866-4679-8a0f-b3dc6fed2b5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:26.731798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7701d22-c866-4679-8a0f-b3dc6fed2b5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:26.732239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7701d22-c866-4679-8a0f-b3dc6fed2b5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:26.763020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c7701d22-c866-4679-8a0f-b3dc6fed2b5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Jul 04 06:00:26.763611 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 435/875] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:27.429989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6108c21c-e372-4e9c-a2c5-71c3986b9939 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:27.430829 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6108c21c-e372-4e9c-a2c5-71c3986b9939 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:27.441519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6108c21c-e372-4e9c-a2c5-71c3986b9939 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:27.441964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6108c21c-e372-4e9c-a2c5-71c3986b9939 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:27.442728 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6108c21c-e372-4e9c-a2c5-71c3986b9939 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:27.443163 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6108c21c-e372-4e9c-a2c5-71c3986b9939 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:27.585890 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6108c21c-e372-4e9c-a2c5-71c3986b9939 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:27.593846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6108c21c-e372-4e9c-a2c5-71c3986b9939 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.170696 Jul 04 06:00:27.594407 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 441/876] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:27 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:27.780217 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b755ea76-085c-41eb-be02-056ee2a5004e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:27.781722 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b755ea76-085c-41eb-be02-056ee2a5004e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:27.792295 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b755ea76-085c-41eb-be02-056ee2a5004e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:27.793045 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b755ea76-085c-41eb-be02-056ee2a5004e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:27.794313 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b755ea76-085c-41eb-be02-056ee2a5004e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:27.795050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b755ea76-085c-41eb-be02-056ee2a5004e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:27.827218 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b755ea76-085c-41eb-be02-056ee2a5004e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054938 Jul 04 06:00:27.827793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 436/877] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:28.613997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0c0ae34d-2ff8-4342-b348-4e93e944e741 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:28.614598 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0c0ae34d-2ff8-4342-b348-4e93e944e741 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:28.621634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c0ae34d-2ff8-4342-b348-4e93e944e741 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:28.622081 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c0ae34d-2ff8-4342-b348-4e93e944e741 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:28.622858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c0ae34d-2ff8-4342-b348-4e93e944e741 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:28.623310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c0ae34d-2ff8-4342-b348-4e93e944e741 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:28.760648 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0c0ae34d-2ff8-4342-b348-4e93e944e741 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:28.772146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0c0ae34d-2ff8-4342-b348-4e93e944e741 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.164396 Jul 04 06:00:28.772674 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 442/878] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:28 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:28.843309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1c28f6c0-becb-4394-ba06-252153ab5352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:28.844803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1c28f6c0-becb-4394-ba06-252153ab5352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:28.853212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c28f6c0-becb-4394-ba06-252153ab5352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:28.853668 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c28f6c0-becb-4394-ba06-252153ab5352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:28.854447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c28f6c0-becb-4394-ba06-252153ab5352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:28.854880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c28f6c0-becb-4394-ba06-252153ab5352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:29.045008 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1c28f6c0-becb-4394-ba06-252153ab5352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208307 Jul 04 06:00:29.045471 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 437/879] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:29.793532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e77aecbc-b7a9-4e25-a967-ca7c6135ce56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:29.794176 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e77aecbc-b7a9-4e25-a967-ca7c6135ce56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:29.801467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e77aecbc-b7a9-4e25-a967-ca7c6135ce56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:29.801948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e77aecbc-b7a9-4e25-a967-ca7c6135ce56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:29.802724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e77aecbc-b7a9-4e25-a967-ca7c6135ce56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:29.803164 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e77aecbc-b7a9-4e25-a967-ca7c6135ce56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:29.946478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e77aecbc-b7a9-4e25-a967-ca7c6135ce56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:29.954613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e77aecbc-b7a9-4e25-a967-ca7c6135ce56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.164951 Jul 04 06:00:29.955184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 443/880] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:29 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:30.059357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-47d9f960-aec1-4ca4-9488-e1e3ff791133 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:30.060691 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-47d9f960-aec1-4ca4-9488-e1e3ff791133 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:30.070337 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47d9f960-aec1-4ca4-9488-e1e3ff791133 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:30.071018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47d9f960-aec1-4ca4-9488-e1e3ff791133 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:30.072144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47d9f960-aec1-4ca4-9488-e1e3ff791133 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:30.072764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47d9f960-aec1-4ca4-9488-e1e3ff791133 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:30.106191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-47d9f960-aec1-4ca4-9488-e1e3ff791133 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052530 Jul 04 06:00:30.106742 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 438/881] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:30 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:30.975366 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a073723f-6e77-4f8e-8890-07899a8e7c3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:30.976121 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a073723f-6e77-4f8e-8890-07899a8e7c3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:30.984225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a073723f-6e77-4f8e-8890-07899a8e7c3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:30.984805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a073723f-6e77-4f8e-8890-07899a8e7c3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:30.985754 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a073723f-6e77-4f8e-8890-07899a8e7c3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:30.986246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a073723f-6e77-4f8e-8890-07899a8e7c3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:31.118056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fa392f54-b158-4d04-86d9-818afe4f4ed3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:31.118982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fa392f54-b158-4d04-86d9-818afe4f4ed3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:31.125639 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa392f54-b158-4d04-86d9-818afe4f4ed3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:31.125845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a073723f-6e77-4f8e-8890-07899a8e7c3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:31.126082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa392f54-b158-4d04-86d9-818afe4f4ed3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:31.127020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa392f54-b158-4d04-86d9-818afe4f4ed3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:31.127530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa392f54-b158-4d04-86d9-818afe4f4ed3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:31.134178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a073723f-6e77-4f8e-8890-07899a8e7c3d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.165078 Jul 04 06:00:31.134853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 444/882] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:30 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:31.157002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fa392f54-b158-4d04-86d9-818afe4f4ed3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042894 Jul 04 06:00:31.157561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 439/883] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:31 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:00:32.154968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a706cad-de87-4146-9a82-ace3c4e1a056 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:32.155976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a706cad-de87-4146-9a82-ace3c4e1a056 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:32.166591 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a706cad-de87-4146-9a82-ace3c4e1a056 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:32.167274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a706cad-de87-4146-9a82-ace3c4e1a056 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:32.168506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a706cad-de87-4146-9a82-ace3c4e1a056 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:32.169219 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a706cad-de87-4146-9a82-ace3c4e1a056 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:32.172038 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b069e5cc-907c-4085-8852-06aefecfb527 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:32.173501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b069e5cc-907c-4085-8852-06aefecfb527 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:32.181356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b069e5cc-907c-4085-8852-06aefecfb527 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:32.181797 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b069e5cc-907c-4085-8852-06aefecfb527 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:32.182590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b069e5cc-907c-4085-8852-06aefecfb527 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:32.183015 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b069e5cc-907c-4085-8852-06aefecfb527 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:32.212345 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b069e5cc-907c-4085-8852-06aefecfb527 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046277 Jul 04 06:00:32.212916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 440/884] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:32 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:32.304981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8a706cad-de87-4146-9a82-ace3c4e1a056 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:32.316277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a706cad-de87-4146-9a82-ace3c4e1a056 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.167057 Jul 04 06:00:32.317017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 445/885] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:32 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:33.228889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-97da5acd-7705-4dbd-a563-91f176f65c61 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:33.230389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-97da5acd-7705-4dbd-a563-91f176f65c61 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:33.241572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97da5acd-7705-4dbd-a563-91f176f65c61 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:33.242342 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97da5acd-7705-4dbd-a563-91f176f65c61 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:33.243786 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97da5acd-7705-4dbd-a563-91f176f65c61 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:33.244510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97da5acd-7705-4dbd-a563-91f176f65c61 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:33.277278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-97da5acd-7705-4dbd-a563-91f176f65c61 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055606 Jul 04 06:00:33.277826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 441/886] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:33.342160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1f7d682c-5194-4017-8015-ad97ab471f52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:33.343189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1f7d682c-5194-4017-8015-ad97ab471f52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:33.352107 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f7d682c-5194-4017-8015-ad97ab471f52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:33.352591 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f7d682c-5194-4017-8015-ad97ab471f52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:33.353357 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f7d682c-5194-4017-8015-ad97ab471f52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:33.353788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f7d682c-5194-4017-8015-ad97ab471f52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:33.488943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f7d682c-5194-4017-8015-ad97ab471f52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:33.500098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f7d682c-5194-4017-8015-ad97ab471f52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.164481 Jul 04 06:00:33.500646 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 446/887] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:33 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:34.294063 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-300f6651-9e62-4f76-bfb3-f5a5e53c8dc8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:34.295642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-300f6651-9e62-4f76-bfb3-f5a5e53c8dc8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:34.304744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-300f6651-9e62-4f76-bfb3-f5a5e53c8dc8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:34.305188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-300f6651-9e62-4f76-bfb3-f5a5e53c8dc8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:34.305958 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-300f6651-9e62-4f76-bfb3-f5a5e53c8dc8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:34.306383 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-300f6651-9e62-4f76-bfb3-f5a5e53c8dc8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:34.336023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-300f6651-9e62-4f76-bfb3-f5a5e53c8dc8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049269 Jul 04 06:00:34.336564 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 442/888] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:34.520417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-84d1a91c-b234-46af-b5d2-86f1cd765f78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:34.521062 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-84d1a91c-b234-46af-b5d2-86f1cd765f78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:34.527659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84d1a91c-b234-46af-b5d2-86f1cd765f78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:34.528100 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84d1a91c-b234-46af-b5d2-86f1cd765f78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:34.528852 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84d1a91c-b234-46af-b5d2-86f1cd765f78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:34.529286 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84d1a91c-b234-46af-b5d2-86f1cd765f78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:34.662271 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-84d1a91c-b234-46af-b5d2-86f1cd765f78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:34.670478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-84d1a91c-b234-46af-b5d2-86f1cd765f78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.156470 Jul 04 06:00:34.671031 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 447/889] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:34 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:35.409102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a656cf6-eab4-4e77-a07b-a0aed350968d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:35.410075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a656cf6-eab4-4e77-a07b-a0aed350968d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:35.417183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a656cf6-eab4-4e77-a07b-a0aed350968d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:35.417632 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a656cf6-eab4-4e77-a07b-a0aed350968d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:35.418391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a656cf6-eab4-4e77-a07b-a0aed350968d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:35.418816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a656cf6-eab4-4e77-a07b-a0aed350968d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:35.449227 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a656cf6-eab4-4e77-a07b-a0aed350968d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102956 Jul 04 06:00:35.450099 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 443/890] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:35.691558 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a0659cd5-deca-4640-8202-4ffb14e124bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:35.692477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a0659cd5-deca-4640-8202-4ffb14e124bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:35.700276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0659cd5-deca-4640-8202-4ffb14e124bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:35.700786 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0659cd5-deca-4640-8202-4ffb14e124bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:35.701613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0659cd5-deca-4640-8202-4ffb14e124bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:35.702094 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0659cd5-deca-4640-8202-4ffb14e124bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:35.852864 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a0659cd5-deca-4640-8202-4ffb14e124bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:35.860966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a0659cd5-deca-4640-8202-4ffb14e124bf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.175910 Jul 04 06:00:35.861541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 448/891] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:35 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:36.467553 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-054749e0-860b-48b8-b88e-5ce4c3dbf976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:36.468957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-054749e0-860b-48b8-b88e-5ce4c3dbf976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:36.477510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-054749e0-860b-48b8-b88e-5ce4c3dbf976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:36.477954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-054749e0-860b-48b8-b88e-5ce4c3dbf976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:36.478710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-054749e0-860b-48b8-b88e-5ce4c3dbf976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:36.479140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-054749e0-860b-48b8-b88e-5ce4c3dbf976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:36.508043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-054749e0-860b-48b8-b88e-5ce4c3dbf976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047241 Jul 04 06:00:36.508581 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 444/892] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:36.881783 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-64a2c3a1-5085-4676-8e76-25f88fd43a1c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:36.882432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-64a2c3a1-5085-4676-8e76-25f88fd43a1c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:36.889482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64a2c3a1-5085-4676-8e76-25f88fd43a1c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:36.889924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64a2c3a1-5085-4676-8e76-25f88fd43a1c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:36.890694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64a2c3a1-5085-4676-8e76-25f88fd43a1c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:36.891127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64a2c3a1-5085-4676-8e76-25f88fd43a1c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:37.040057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-64a2c3a1-5085-4676-8e76-25f88fd43a1c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:37.047589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-64a2c3a1-5085-4676-8e76-25f88fd43a1c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.171766 Jul 04 06:00:37.048195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 449/893] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:36 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:37.522987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-177a722b-03c3-43ec-b2d1-50bfddb27827 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:37.523945 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-177a722b-03c3-43ec-b2d1-50bfddb27827 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:37.530456 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-177a722b-03c3-43ec-b2d1-50bfddb27827 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:37.530911 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-177a722b-03c3-43ec-b2d1-50bfddb27827 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:37.531707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-177a722b-03c3-43ec-b2d1-50bfddb27827 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:37.532149 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-177a722b-03c3-43ec-b2d1-50bfddb27827 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:37.561690 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-177a722b-03c3-43ec-b2d1-50bfddb27827 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044422 Jul 04 06:00:37.562243 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 445/894] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:38.066249 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-736d246a-fa6f-4f0d-8c99-3bad16da2b0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:38.066988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-736d246a-fa6f-4f0d-8c99-3bad16da2b0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:38.076030 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-736d246a-fa6f-4f0d-8c99-3bad16da2b0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:38.076191 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-736d246a-fa6f-4f0d-8c99-3bad16da2b0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:38.077984 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-736d246a-fa6f-4f0d-8c99-3bad16da2b0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:38.077984 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-736d246a-fa6f-4f0d-8c99-3bad16da2b0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:38.213708 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-736d246a-fa6f-4f0d-8c99-3bad16da2b0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:38.221320 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-736d246a-fa6f-4f0d-8c99-3bad16da2b0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.159965 Jul 04 06:00:38.221890 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 450/895] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:38 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:38.581191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b12c3d8b-e5ee-4a9e-a1e9-5d36765e7616 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:38.583140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b12c3d8b-e5ee-4a9e-a1e9-5d36765e7616 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:38.595160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b12c3d8b-e5ee-4a9e-a1e9-5d36765e7616 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:38.595982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b12c3d8b-e5ee-4a9e-a1e9-5d36765e7616 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:38.597273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b12c3d8b-e5ee-4a9e-a1e9-5d36765e7616 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:38.598010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b12c3d8b-e5ee-4a9e-a1e9-5d36765e7616 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:38.617042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:38.631088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b12c3d8b-e5ee-4a9e-a1e9-5d36765e7616 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060088 Jul 04 06:00:38.631679 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 446/896] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:39.238035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-381691e6-eb53-4cfc-ac70-5f74682d7ee3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:39.238648 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-381691e6-eb53-4cfc-ac70-5f74682d7ee3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:39.246253 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381691e6-eb53-4cfc-ac70-5f74682d7ee3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:39.246703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381691e6-eb53-4cfc-ac70-5f74682d7ee3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:39.247495 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381691e6-eb53-4cfc-ac70-5f74682d7ee3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:39.247916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381691e6-eb53-4cfc-ac70-5f74682d7ee3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:39.385858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-381691e6-eb53-4cfc-ac70-5f74682d7ee3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:39.395768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-381691e6-eb53-4cfc-ac70-5f74682d7ee3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.161541 Jul 04 06:00:39.396382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 451/897] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:39 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:39.646394 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5909ca35-1118-47a8-baf3-611c4faaf33d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:39.647592 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5909ca35-1118-47a8-baf3-611c4faaf33d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:39.655752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5909ca35-1118-47a8-baf3-611c4faaf33d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:39.656287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5909ca35-1118-47a8-baf3-611c4faaf33d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:39.657194 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5909ca35-1118-47a8-baf3-611c4faaf33d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:39.657710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5909ca35-1118-47a8-baf3-611c4faaf33d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:39.690992 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5909ca35-1118-47a8-baf3-611c4faaf33d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051331 Jul 04 06:00:39.691573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 447/898] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:40.417458 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ab905ce7-fae3-4477-9af2-3c76c72729d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:40.418506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ab905ce7-fae3-4477-9af2-3c76c72729d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:40.428965 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab905ce7-fae3-4477-9af2-3c76c72729d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:40.429406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab905ce7-fae3-4477-9af2-3c76c72729d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:40.430156 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab905ce7-fae3-4477-9af2-3c76c72729d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:40.430586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab905ce7-fae3-4477-9af2-3c76c72729d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:40.572628 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ab905ce7-fae3-4477-9af2-3c76c72729d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:40.580616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ab905ce7-fae3-4477-9af2-3c76c72729d8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.170149 Jul 04 06:00:40.581237 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 452/899] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:40 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:40.707599 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93766fd7-788b-482a-8424-088ce3350768 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:40.709040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-93766fd7-788b-482a-8424-088ce3350768 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:40.720800 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93766fd7-788b-482a-8424-088ce3350768 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:40.721550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93766fd7-788b-482a-8424-088ce3350768 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:40.722822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93766fd7-788b-482a-8424-088ce3350768 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:40.723654 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93766fd7-788b-482a-8424-088ce3350768 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:40.753308 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-93766fd7-788b-482a-8424-088ce3350768 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052668 Jul 04 06:00:40.753861 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 448/900] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:41.600637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-108be5aa-41ba-4b87-bcb6-9029e9cb8018 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:41.601223 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-108be5aa-41ba-4b87-bcb6-9029e9cb8018 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:41.609048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-108be5aa-41ba-4b87-bcb6-9029e9cb8018 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:41.609546 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-108be5aa-41ba-4b87-bcb6-9029e9cb8018 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:41.610423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-108be5aa-41ba-4b87-bcb6-9029e9cb8018 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:41.610904 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-108be5aa-41ba-4b87-bcb6-9029e9cb8018 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:41.748234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-108be5aa-41ba-4b87-bcb6-9029e9cb8018 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:41.755937 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-108be5aa-41ba-4b87-bcb6-9029e9cb8018 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.160910 Jul 04 06:00:41.756493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 453/901] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:41 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:41.765652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6fc3479e-deb4-4f4a-b55d-2a40f5de54cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:41.766586 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6fc3479e-deb4-4f4a-b55d-2a40f5de54cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:41.773507 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6fc3479e-deb4-4f4a-b55d-2a40f5de54cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:41.773964 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6fc3479e-deb4-4f4a-b55d-2a40f5de54cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:41.774735 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6fc3479e-deb4-4f4a-b55d-2a40f5de54cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:41.775176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6fc3479e-deb4-4f4a-b55d-2a40f5de54cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:41.805209 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6fc3479e-deb4-4f4a-b55d-2a40f5de54cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043619 Jul 04 06:00:41.805758 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 449/902] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:41 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:42.777242 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-18510009-26c6-4ba3-bdef-c0c9ce0d264c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:42.778228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-18510009-26c6-4ba3-bdef-c0c9ce0d264c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:42.789751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18510009-26c6-4ba3-bdef-c0c9ce0d264c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:42.790493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18510009-26c6-4ba3-bdef-c0c9ce0d264c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:42.791807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18510009-26c6-4ba3-bdef-c0c9ce0d264c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:42.792528 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18510009-26c6-4ba3-bdef-c0c9ce0d264c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:42.814583 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:42.818995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-192a51a3-8a07-47fd-ac14-5a7344e38992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:42.819949 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-192a51a3-8a07-47fd-ac14-5a7344e38992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:42.826570 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-192a51a3-8a07-47fd-ac14-5a7344e38992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:42.827021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-192a51a3-8a07-47fd-ac14-5a7344e38992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:42.827846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-192a51a3-8a07-47fd-ac14-5a7344e38992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:42.828275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-192a51a3-8a07-47fd-ac14-5a7344e38992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:42.858285 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-192a51a3-8a07-47fd-ac14-5a7344e38992 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043294 Jul 04 06:00:42.858831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 450/903] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:42 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:42.935396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-18510009-26c6-4ba3-bdef-c0c9ce0d264c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:42.942967 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-18510009-26c6-4ba3-bdef-c0c9ce0d264c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.172465 Jul 04 06:00:42.943652 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 454/904] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:42 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:43.874252 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-71312f38-e419-4f9d-920e-82f7bea922f3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:43.875687 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-71312f38-e419-4f9d-920e-82f7bea922f3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:43.884681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71312f38-e419-4f9d-920e-82f7bea922f3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:43.885134 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71312f38-e419-4f9d-920e-82f7bea922f3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:43.885909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71312f38-e419-4f9d-920e-82f7bea922f3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:43.886346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71312f38-e419-4f9d-920e-82f7bea922f3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:43.918546 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-71312f38-e419-4f9d-920e-82f7bea922f3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051045 Jul 04 06:00:43.919101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 451/905] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:43.961675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e904ac38-6edd-4656-b65b-82a607f77bed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:43.962270 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e904ac38-6edd-4656-b65b-82a607f77bed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:43.969236 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e904ac38-6edd-4656-b65b-82a607f77bed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:43.969690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e904ac38-6edd-4656-b65b-82a607f77bed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:43.970461 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e904ac38-6edd-4656-b65b-82a607f77bed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:43.970894 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e904ac38-6edd-4656-b65b-82a607f77bed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:44.115863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e904ac38-6edd-4656-b65b-82a607f77bed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:44.123650 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e904ac38-6edd-4656-b65b-82a607f77bed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.165822 Jul 04 06:00:44.124226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 455/906] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:43 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:44.932297 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-697d0f0d-ddff-4908-a3cc-a5031f7f6039 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:44.933123 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-697d0f0d-ddff-4908-a3cc-a5031f7f6039 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:44.940353 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-697d0f0d-ddff-4908-a3cc-a5031f7f6039 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:44.940804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-697d0f0d-ddff-4908-a3cc-a5031f7f6039 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:44.941558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-697d0f0d-ddff-4908-a3cc-a5031f7f6039 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:44.941991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-697d0f0d-ddff-4908-a3cc-a5031f7f6039 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:44.970577 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-697d0f0d-ddff-4908-a3cc-a5031f7f6039 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042814 Jul 04 06:00:44.971094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 452/907] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:44 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:45.144632 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a39b577e-8a54-4638-a8e2-bfea01b8f1c4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:45.145585 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a39b577e-8a54-4638-a8e2-bfea01b8f1c4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:45.156880 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a39b577e-8a54-4638-a8e2-bfea01b8f1c4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:45.157637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a39b577e-8a54-4638-a8e2-bfea01b8f1c4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:45.158963 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a39b577e-8a54-4638-a8e2-bfea01b8f1c4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:45.159733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a39b577e-8a54-4638-a8e2-bfea01b8f1c4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:45.307432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a39b577e-8a54-4638-a8e2-bfea01b8f1c4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:45.319142 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a39b577e-8a54-4638-a8e2-bfea01b8f1c4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.180943 Jul 04 06:00:45.319746 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 456/908] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:45 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:45.986267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-351cf367-ebcf-401d-b234-2453dee412d8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:45.987799 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-351cf367-ebcf-401d-b234-2453dee412d8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:45.999332 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-351cf367-ebcf-401d-b234-2453dee412d8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:46.000219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-351cf367-ebcf-401d-b234-2453dee412d8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:46.001473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-351cf367-ebcf-401d-b234-2453dee412d8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:46.002231 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-351cf367-ebcf-401d-b234-2453dee412d8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:46.033542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-351cf367-ebcf-401d-b234-2453dee412d8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053841 Jul 04 06:00:46.034241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 453/909] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:46.340486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-74be7a30-37a3-4a91-acfd-991d71126c48 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:46.341586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-74be7a30-37a3-4a91-acfd-991d71126c48 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:46.353076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74be7a30-37a3-4a91-acfd-991d71126c48 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:46.353785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74be7a30-37a3-4a91-acfd-991d71126c48 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:46.355050 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74be7a30-37a3-4a91-acfd-991d71126c48 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:46.355830 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74be7a30-37a3-4a91-acfd-991d71126c48 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:46.494316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-74be7a30-37a3-4a91-acfd-991d71126c48 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:46.501997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-74be7a30-37a3-4a91-acfd-991d71126c48 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.168307 Jul 04 06:00:46.502592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 457/910] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:46 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:47.046379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-83d28ad1-c8d2-4146-b746-8cd9981691b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:47.047344 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-83d28ad1-c8d2-4146-b746-8cd9981691b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:47.054361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83d28ad1-c8d2-4146-b746-8cd9981691b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:47.054828 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83d28ad1-c8d2-4146-b746-8cd9981691b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:47.055685 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83d28ad1-c8d2-4146-b746-8cd9981691b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:47.056129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83d28ad1-c8d2-4146-b746-8cd9981691b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:47.087818 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-83d28ad1-c8d2-4146-b746-8cd9981691b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045491 Jul 04 06:00:47.088395 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 454/911] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:47.518641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b34c1bde-22c9-4131-8a1d-023e47835533 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:47.519034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b34c1bde-22c9-4131-8a1d-023e47835533 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:47.525614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b34c1bde-22c9-4131-8a1d-023e47835533 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:47.526067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b34c1bde-22c9-4131-8a1d-023e47835533 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:47.526841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b34c1bde-22c9-4131-8a1d-023e47835533 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:47.527290 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b34c1bde-22c9-4131-8a1d-023e47835533 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:47.674500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b34c1bde-22c9-4131-8a1d-023e47835533 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:47.682919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b34c1bde-22c9-4131-8a1d-023e47835533 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.168632 Jul 04 06:00:47.683550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 458/912] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:47 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:48.102584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0cf5f824-549f-4dc9-8501-61dabdb83495 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:48.103838 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0cf5f824-549f-4dc9-8501-61dabdb83495 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:48.112874 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf5f824-549f-4dc9-8501-61dabdb83495 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:48.113473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf5f824-549f-4dc9-8501-61dabdb83495 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:48.114483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf5f824-549f-4dc9-8501-61dabdb83495 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:48.115192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf5f824-549f-4dc9-8501-61dabdb83495 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:48.146004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0cf5f824-549f-4dc9-8501-61dabdb83495 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048661 Jul 04 06:00:48.146618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 455/913] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:48.703486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-975a6f55-993b-4b11-8a4f-11e5132fafa2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:48.705551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-975a6f55-993b-4b11-8a4f-11e5132fafa2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:48.708737 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=58 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:48.715125 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-975a6f55-993b-4b11-8a4f-11e5132fafa2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:48.716520 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-975a6f55-993b-4b11-8a4f-11e5132fafa2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:48.717841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-975a6f55-993b-4b11-8a4f-11e5132fafa2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:48.718345 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-975a6f55-993b-4b11-8a4f-11e5132fafa2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:48.863445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-975a6f55-993b-4b11-8a4f-11e5132fafa2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:48.871114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-975a6f55-993b-4b11-8a4f-11e5132fafa2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.174246 Jul 04 06:00:48.871701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 459/914] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:48 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:49.162520 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f28efbb7-dcff-4bda-98ce-036a46d42367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:49.163384 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f28efbb7-dcff-4bda-98ce-036a46d42367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:49.170211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f28efbb7-dcff-4bda-98ce-036a46d42367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:49.170666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f28efbb7-dcff-4bda-98ce-036a46d42367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:49.171474 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f28efbb7-dcff-4bda-98ce-036a46d42367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:49.171908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f28efbb7-dcff-4bda-98ce-036a46d42367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:49.201260 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f28efbb7-dcff-4bda-98ce-036a46d42367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045812 Jul 04 06:00:49.201995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 456/915] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:49.892249 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b1d748d0-fa8b-4875-9c78-1f03ae3d2282 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:49.893255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b1d748d0-fa8b-4875-9c78-1f03ae3d2282 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:49.904333 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1d748d0-fa8b-4875-9c78-1f03ae3d2282 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:49.905074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1d748d0-fa8b-4875-9c78-1f03ae3d2282 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:49.906331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1d748d0-fa8b-4875-9c78-1f03ae3d2282 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:49.907107 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1d748d0-fa8b-4875-9c78-1f03ae3d2282 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:50.060752 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b1d748d0-fa8b-4875-9c78-1f03ae3d2282 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:50.069231 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b1d748d0-fa8b-4875-9c78-1f03ae3d2282 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.183419 Jul 04 06:00:50.069702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 460/916] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:49 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:50.214884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9fefd0c2-ecb6-4f7f-8f66-a99808d179bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:50.216034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9fefd0c2-ecb6-4f7f-8f66-a99808d179bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:50.224204 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9fefd0c2-ecb6-4f7f-8f66-a99808d179bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:50.224995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9fefd0c2-ecb6-4f7f-8f66-a99808d179bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:50.225941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9fefd0c2-ecb6-4f7f-8f66-a99808d179bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:50.226480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9fefd0c2-ecb6-4f7f-8f66-a99808d179bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:50.258407 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9fefd0c2-ecb6-4f7f-8f66-a99808d179bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048396 Jul 04 06:00:50.259094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 457/917] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:50 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:51.090688 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e53b20a8-0bce-4347-82c3-94039960a651 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:51.091588 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e53b20a8-0bce-4347-82c3-94039960a651 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:51.102931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e53b20a8-0bce-4347-82c3-94039960a651 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:51.103748 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e53b20a8-0bce-4347-82c3-94039960a651 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:51.105016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e53b20a8-0bce-4347-82c3-94039960a651 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:51.105733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e53b20a8-0bce-4347-82c3-94039960a651 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:51.248952 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e53b20a8-0bce-4347-82c3-94039960a651 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:51.256741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e53b20a8-0bce-4347-82c3-94039960a651 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.172791 Jul 04 06:00:51.257317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 461/918] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:51 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:51.272461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce47ec1c-48b3-4ee7-aea5-b61f328ea7f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:51.273597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ce47ec1c-48b3-4ee7-aea5-b61f328ea7f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:51.282230 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce47ec1c-48b3-4ee7-aea5-b61f328ea7f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:51.282693 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce47ec1c-48b3-4ee7-aea5-b61f328ea7f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:51.283499 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce47ec1c-48b3-4ee7-aea5-b61f328ea7f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:51.283943 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce47ec1c-48b3-4ee7-aea5-b61f328ea7f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:51.314104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce47ec1c-48b3-4ee7-aea5-b61f328ea7f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047915 Jul 04 06:00:51.314694 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 458/919] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:51 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:52.275384 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0fa2b52d-03f4-458c-96ec-d7cf49f39a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:52.275972 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0fa2b52d-03f4-458c-96ec-d7cf49f39a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:52.282886 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fa2b52d-03f4-458c-96ec-d7cf49f39a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:52.283369 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fa2b52d-03f4-458c-96ec-d7cf49f39a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:52.284139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fa2b52d-03f4-458c-96ec-d7cf49f39a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:52.284575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fa2b52d-03f4-458c-96ec-d7cf49f39a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:52.326049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8d506b71-10cb-456b-a368-3aadef547ee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:52.328130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8d506b71-10cb-456b-a368-3aadef547ee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:52.334064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d506b71-10cb-456b-a368-3aadef547ee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:52.334512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d506b71-10cb-456b-a368-3aadef547ee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:52.335293 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d506b71-10cb-456b-a368-3aadef547ee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:52.335905 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d506b71-10cb-456b-a368-3aadef547ee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:52.366141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8d506b71-10cb-456b-a368-3aadef547ee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044048 Jul 04 06:00:52.366636 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 459/920] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:52 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:52.423419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0fa2b52d-03f4-458c-96ec-d7cf49f39a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:52.431233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0fa2b52d-03f4-458c-96ec-d7cf49f39a6b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.159991 Jul 04 06:00:52.431771 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 462/921] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:52 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:53.382007 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a89670e-77cc-42fb-89f2-866d33674e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:53.383886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a89670e-77cc-42fb-89f2-866d33674e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:53.395023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a89670e-77cc-42fb-89f2-866d33674e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:53.395829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a89670e-77cc-42fb-89f2-866d33674e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:53.396885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a89670e-77cc-42fb-89f2-866d33674e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:53.397310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a89670e-77cc-42fb-89f2-866d33674e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:53.427280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a89670e-77cc-42fb-89f2-866d33674e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051925 Jul 04 06:00:53.427906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 460/922] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:53 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:53.448225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1f3749e6-c6ac-4ebd-abb9-35d2fd22ca78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:53.448811 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1f3749e6-c6ac-4ebd-abb9-35d2fd22ca78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:53.455783 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f3749e6-c6ac-4ebd-abb9-35d2fd22ca78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:53.456224 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f3749e6-c6ac-4ebd-abb9-35d2fd22ca78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:53.456990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f3749e6-c6ac-4ebd-abb9-35d2fd22ca78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:53.457421 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f3749e6-c6ac-4ebd-abb9-35d2fd22ca78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:53.589898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f3749e6-c6ac-4ebd-abb9-35d2fd22ca78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:53.600974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f3749e6-c6ac-4ebd-abb9-35d2fd22ca78 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.156305 Jul 04 06:00:53.601747 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 463/923] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:53 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:54.438857 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-338d1cfe-bead-48ba-9733-b17d6b9825a9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:54.439815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-338d1cfe-bead-48ba-9733-b17d6b9825a9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:54.447476 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-338d1cfe-bead-48ba-9733-b17d6b9825a9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:54.447924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-338d1cfe-bead-48ba-9733-b17d6b9825a9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:54.448712 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-338d1cfe-bead-48ba-9733-b17d6b9825a9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:54.449150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-338d1cfe-bead-48ba-9733-b17d6b9825a9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:54.478781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-338d1cfe-bead-48ba-9733-b17d6b9825a9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043939 Jul 04 06:00:54.479380 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 461/924] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:54.627318 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-037b3c3d-8b72-415d-a793-dfb944b6ef39 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:54.628531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-037b3c3d-8b72-415d-a793-dfb944b6ef39 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:54.639647 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-037b3c3d-8b72-415d-a793-dfb944b6ef39 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:54.640380 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-037b3c3d-8b72-415d-a793-dfb944b6ef39 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:54.641633 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-037b3c3d-8b72-415d-a793-dfb944b6ef39 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:54.642348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-037b3c3d-8b72-415d-a793-dfb944b6ef39 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:54.784766 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-037b3c3d-8b72-415d-a793-dfb944b6ef39 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:54.793112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-037b3c3d-8b72-415d-a793-dfb944b6ef39 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.172147 Jul 04 06:00:54.793693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 464/925] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:54 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:55.493549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4eec8e5b-5d47-4a7d-8482-1dea51294be2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:55.494613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4eec8e5b-5d47-4a7d-8482-1dea51294be2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:55.497336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=58 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:55.504555 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eec8e5b-5d47-4a7d-8482-1dea51294be2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:55.505076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eec8e5b-5d47-4a7d-8482-1dea51294be2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:55.505963 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eec8e5b-5d47-4a7d-8482-1dea51294be2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:55.506482 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eec8e5b-5d47-4a7d-8482-1dea51294be2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:55.540213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4eec8e5b-5d47-4a7d-8482-1dea51294be2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052303 Jul 04 06:00:55.540736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 462/926] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:55.810896 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-df105dcb-e526-4e7f-991a-88556daadd7c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:55.811517 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-df105dcb-e526-4e7f-991a-88556daadd7c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:55.818852 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df105dcb-e526-4e7f-991a-88556daadd7c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:55.819317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df105dcb-e526-4e7f-991a-88556daadd7c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:55.820085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df105dcb-e526-4e7f-991a-88556daadd7c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:55.820521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df105dcb-e526-4e7f-991a-88556daadd7c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:55.967527 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df105dcb-e526-4e7f-991a-88556daadd7c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:55.975524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-df105dcb-e526-4e7f-991a-88556daadd7c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.168607 Jul 04 06:00:55.976097 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 465/927] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:55 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:56.551846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a41c37ac-9ee8-4ae1-833d-38fa379fad57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:56.552887 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a41c37ac-9ee8-4ae1-833d-38fa379fad57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:56.559515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a41c37ac-9ee8-4ae1-833d-38fa379fad57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:56.559970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a41c37ac-9ee8-4ae1-833d-38fa379fad57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:56.560728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a41c37ac-9ee8-4ae1-833d-38fa379fad57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:56.561166 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a41c37ac-9ee8-4ae1-833d-38fa379fad57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:56.564898 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:56.590328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a41c37ac-9ee8-4ae1-833d-38fa379fad57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042654 Jul 04 06:00:56.590901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 463/928] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:56 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:56.844788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0dfa4567-c2c0-4396-a9ba-6a7087886305 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:56.845668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0dfa4567-c2c0-4396-a9ba-6a7087886305 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:56.856793 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dfa4567-c2c0-4396-a9ba-6a7087886305 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:56.857539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dfa4567-c2c0-4396-a9ba-6a7087886305 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:56.858803 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dfa4567-c2c0-4396-a9ba-6a7087886305 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:56.859583 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dfa4567-c2c0-4396-a9ba-6a7087886305 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:56.885962 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0dfa4567-c2c0-4396-a9ba-6a7087886305 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd/ips" status: 200 len: 147 microversion: 2.1 time: 0.046815 Jul 04 06:00:56.886551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 466/929] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jul 4 06:00:56 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd/ips => generated 147 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:56.948502 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:00:56.948761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:00:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:00:56.992727 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c5689676-c08a-4a8a-b57e-99c7cdc727ed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:56.993395 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c5689676-c08a-4a8a-b57e-99c7cdc727ed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:56.999963 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5689676-c08a-4a8a-b57e-99c7cdc727ed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:57.000409 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5689676-c08a-4a8a-b57e-99c7cdc727ed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:57.001160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5689676-c08a-4a8a-b57e-99c7cdc727ed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:57.001604 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5689676-c08a-4a8a-b57e-99c7cdc727ed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:57.146126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5689676-c08a-4a8a-b57e-99c7cdc727ed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:57.154841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c5689676-c08a-4a8a-b57e-99c7cdc727ed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.166132 Jul 04 06:00:57.164400 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 464/930] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:56 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:57.606510 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-47c3a1d6-5cbd-465b-ab35-7c5e6ace60f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:57.608755 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-47c3a1d6-5cbd-465b-ab35-7c5e6ace60f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:57.617741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47c3a1d6-5cbd-465b-ab35-7c5e6ace60f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:57.618185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47c3a1d6-5cbd-465b-ab35-7c5e6ace60f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:57.618953 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47c3a1d6-5cbd-465b-ab35-7c5e6ace60f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:57.619453 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47c3a1d6-5cbd-465b-ab35-7c5e6ace60f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:57.648864 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-47c3a1d6-5cbd-465b-ab35-7c5e6ace60f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049568 Jul 04 06:00:57.649454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 467/931] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:57 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:58.175883 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9aa47ad9-6666-4259-bef8-908b642426d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:58.176888 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9aa47ad9-6666-4259-bef8-908b642426d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:58.188435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9aa47ad9-6666-4259-bef8-908b642426d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:58.189171 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9aa47ad9-6666-4259-bef8-908b642426d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:58.190421 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9aa47ad9-6666-4259-bef8-908b642426d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:58.191140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9aa47ad9-6666-4259-bef8-908b642426d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:58.324439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9aa47ad9-6666-4259-bef8-908b642426d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:58.331966 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9aa47ad9-6666-4259-bef8-908b642426d3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.162765 Jul 04 06:00:58.332517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 465/932] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:58 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:58.660365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3767d9c-6b7a-4dda-b4da-083c2a035c18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:58.662298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e3767d9c-6b7a-4dda-b4da-083c2a035c18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:58.669030 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3767d9c-6b7a-4dda-b4da-083c2a035c18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:58.669484 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3767d9c-6b7a-4dda-b4da-083c2a035c18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:58.670250 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3767d9c-6b7a-4dda-b4da-083c2a035c18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:58.670690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3767d9c-6b7a-4dda-b4da-083c2a035c18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:58.701185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e3767d9c-6b7a-4dda-b4da-083c2a035c18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 Jul 04 06:00:58.701185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 468/933] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:00:59.349381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-24c5ebc6-6489-4fee-bc0e-7a86bcd2bb3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:59.349988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-24c5ebc6-6489-4fee-bc0e-7a86bcd2bb3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:59.356591 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24c5ebc6-6489-4fee-bc0e-7a86bcd2bb3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:59.357162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24c5ebc6-6489-4fee-bc0e-7a86bcd2bb3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:59.357930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24c5ebc6-6489-4fee-bc0e-7a86bcd2bb3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:59.358363 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24c5ebc6-6489-4fee-bc0e-7a86bcd2bb3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:59.498410 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-24c5ebc6-6489-4fee-bc0e-7a86bcd2bb3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:00:59.508324 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-24c5ebc6-6489-4fee-bc0e-7a86bcd2bb3e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.163019 Jul 04 06:00:59.508940 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 466/934] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:00:59 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:00:59.712212 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2669a886-07bd-45bb-a6a3-c5d1d3755e47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:00:59.713165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2669a886-07bd-45bb-a6a3-c5d1d3755e47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:00:59.720064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2669a886-07bd-45bb-a6a3-c5d1d3755e47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:59.720518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2669a886-07bd-45bb-a6a3-c5d1d3755e47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:59.721288 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2669a886-07bd-45bb-a6a3-c5d1d3755e47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:00:59.721746 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2669a886-07bd-45bb-a6a3-c5d1d3755e47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:00:59.751079 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2669a886-07bd-45bb-a6a3-c5d1d3755e47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042753 Jul 04 06:00:59.751599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 469/935] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:00:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:00.528701 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b84d8200-f485-4be6-842b-2bab268abd29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:00.529403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b84d8200-f485-4be6-842b-2bab268abd29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:00.540084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b84d8200-f485-4be6-842b-2bab268abd29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:00.540566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b84d8200-f485-4be6-842b-2bab268abd29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:00.541722 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b84d8200-f485-4be6-842b-2bab268abd29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:00.542142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b84d8200-f485-4be6-842b-2bab268abd29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:00.683942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b84d8200-f485-4be6-842b-2bab268abd29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:00.695065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b84d8200-f485-4be6-842b-2bab268abd29 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.172100 Jul 04 06:01:00.695895 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 467/936] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:00 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:00.766450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a59b8fcd-dba2-4f26-946a-3290e1659fd1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:00.768064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a59b8fcd-dba2-4f26-946a-3290e1659fd1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:00.777710 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a59b8fcd-dba2-4f26-946a-3290e1659fd1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:00.778137 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a59b8fcd-dba2-4f26-946a-3290e1659fd1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:00.778911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a59b8fcd-dba2-4f26-946a-3290e1659fd1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:00.779397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a59b8fcd-dba2-4f26-946a-3290e1659fd1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:00.810326 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a59b8fcd-dba2-4f26-946a-3290e1659fd1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050647 Jul 04 06:01:00.810882 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 470/937] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:00 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:01.721197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a49310b6-7f79-4d81-b5ff-37e39759a535 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:01.722042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a49310b6-7f79-4d81-b5ff-37e39759a535 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:01.730004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a49310b6-7f79-4d81-b5ff-37e39759a535 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:01.730506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a49310b6-7f79-4d81-b5ff-37e39759a535 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:01.731196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a49310b6-7f79-4d81-b5ff-37e39759a535 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:01.731705 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a49310b6-7f79-4d81-b5ff-37e39759a535 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:01.822227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ae93dca-17b0-40b3-9e99-65df0b4925d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:01.823440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8ae93dca-17b0-40b3-9e99-65df0b4925d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:01.831012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ae93dca-17b0-40b3-9e99-65df0b4925d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:01.831590 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ae93dca-17b0-40b3-9e99-65df0b4925d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:01.832371 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ae93dca-17b0-40b3-9e99-65df0b4925d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:01.832821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ae93dca-17b0-40b3-9e99-65df0b4925d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:01.851898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:01.866172 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ae93dca-17b0-40b3-9e99-65df0b4925d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047867 Jul 04 06:01:01.866743 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 471/938] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:01 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:01.868223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a49310b6-7f79-4d81-b5ff-37e39759a535 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:01.875932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a49310b6-7f79-4d81-b5ff-37e39759a535 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.161346 Jul 04 06:01:01.876475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 468/939] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:01 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:02.878832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dbf62f47-ad46-47ac-b537-19365e97ce11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:02.879789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dbf62f47-ad46-47ac-b537-19365e97ce11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:02.886599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dbf62f47-ad46-47ac-b537-19365e97ce11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:02.887045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dbf62f47-ad46-47ac-b537-19365e97ce11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:02.887928 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dbf62f47-ad46-47ac-b537-19365e97ce11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:02.888379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dbf62f47-ad46-47ac-b537-19365e97ce11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:02.892737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a05ecbf9-d660-49c9-9774-642d61ae035e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:02.893383 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a05ecbf9-d660-49c9-9774-642d61ae035e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:02.900524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a05ecbf9-d660-49c9-9774-642d61ae035e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:02.901048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a05ecbf9-d660-49c9-9774-642d61ae035e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:02.901890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a05ecbf9-d660-49c9-9774-642d61ae035e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:02.902399 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a05ecbf9-d660-49c9-9774-642d61ae035e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:02.921515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dbf62f47-ad46-47ac-b537-19365e97ce11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046505 Jul 04 06:01:02.922469 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 472/940] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:02 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:03.039086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a05ecbf9-d660-49c9-9774-642d61ae035e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:03.048314 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a05ecbf9-d660-49c9-9774-642d61ae035e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.159568 Jul 04 06:01:03.048848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 469/941] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:02 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:03.938124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-75e76536-3cff-4de1-938a-29dc9ac3e92c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:03.939708 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-75e76536-3cff-4de1-938a-29dc9ac3e92c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:03.948422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75e76536-3cff-4de1-938a-29dc9ac3e92c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:03.948869 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75e76536-3cff-4de1-938a-29dc9ac3e92c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:03.949634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75e76536-3cff-4de1-938a-29dc9ac3e92c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:03.950064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75e76536-3cff-4de1-938a-29dc9ac3e92c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:03.981564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-75e76536-3cff-4de1-938a-29dc9ac3e92c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050014 Jul 04 06:01:03.982096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 473/942] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:04.072542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c7fbadab-6f4d-4c7f-b74a-2fd1d1f8d52e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:04.073250 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c7fbadab-6f4d-4c7f-b74a-2fd1d1f8d52e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:04.081202 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7fbadab-6f4d-4c7f-b74a-2fd1d1f8d52e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:04.081733 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7fbadab-6f4d-4c7f-b74a-2fd1d1f8d52e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:04.082613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7fbadab-6f4d-4c7f-b74a-2fd1d1f8d52e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:04.083119 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7fbadab-6f4d-4c7f-b74a-2fd1d1f8d52e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:04.226136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c7fbadab-6f4d-4c7f-b74a-2fd1d1f8d52e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:04.234192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c7fbadab-6f4d-4c7f-b74a-2fd1d1f8d52e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.167139 Jul 04 06:01:04.234730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 470/943] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:04 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:04.995150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a0c98840-a966-40e7-8329-fcec23a3c5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:04.996185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a0c98840-a966-40e7-8329-fcec23a3c5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:05.003084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0c98840-a966-40e7-8329-fcec23a3c5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:05.003566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0c98840-a966-40e7-8329-fcec23a3c5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:05.004343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0c98840-a966-40e7-8329-fcec23a3c5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:05.004770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0c98840-a966-40e7-8329-fcec23a3c5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:05.189565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a0c98840-a966-40e7-8329-fcec23a3c5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198881 Jul 04 06:01:05.190133 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 474/944] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:05.251527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6a2a3ed-c644-4777-af9b-3ff4cff13c43 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:05.252077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e6a2a3ed-c644-4777-af9b-3ff4cff13c43 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:05.259093 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6a2a3ed-c644-4777-af9b-3ff4cff13c43 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:05.259570 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6a2a3ed-c644-4777-af9b-3ff4cff13c43 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:05.260320 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6a2a3ed-c644-4777-af9b-3ff4cff13c43 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:05.260751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6a2a3ed-c644-4777-af9b-3ff4cff13c43 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:05.401903 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6a2a3ed-c644-4777-af9b-3ff4cff13c43 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:05.409530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e6a2a3ed-c644-4777-af9b-3ff4cff13c43 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.162033 Jul 04 06:01:05.410095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 471/945] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:05 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:06.202395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d4a070a9-fb23-452d-b69d-e4424cfd6459 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:06.203286 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d4a070a9-fb23-452d-b69d-e4424cfd6459 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:06.210450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4a070a9-fb23-452d-b69d-e4424cfd6459 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:06.210895 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4a070a9-fb23-452d-b69d-e4424cfd6459 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:06.211706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4a070a9-fb23-452d-b69d-e4424cfd6459 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:06.212143 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4a070a9-fb23-452d-b69d-e4424cfd6459 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:06.247963 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d4a070a9-fb23-452d-b69d-e4424cfd6459 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049658 Jul 04 06:01:06.248506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 475/946] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:06.430198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42a64a64-5d9f-437f-a48d-2630a877cdbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:06.430978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-42a64a64-5d9f-437f-a48d-2630a877cdbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:06.438833 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42a64a64-5d9f-437f-a48d-2630a877cdbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:06.439393 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42a64a64-5d9f-437f-a48d-2630a877cdbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:06.440281 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42a64a64-5d9f-437f-a48d-2630a877cdbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:06.440784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42a64a64-5d9f-437f-a48d-2630a877cdbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:06.592242 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-42a64a64-5d9f-437f-a48d-2630a877cdbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:06.599994 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-42a64a64-5d9f-437f-a48d-2630a877cdbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.175990 Jul 04 06:01:06.600567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 472/947] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:06 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:07.261997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6ad575ad-e82f-400a-9cb0-2bfa58d5e815 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:07.262927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6ad575ad-e82f-400a-9cb0-2bfa58d5e815 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:07.269967 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ad575ad-e82f-400a-9cb0-2bfa58d5e815 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:07.270423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ad575ad-e82f-400a-9cb0-2bfa58d5e815 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:07.271228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ad575ad-e82f-400a-9cb0-2bfa58d5e815 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:07.271740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ad575ad-e82f-400a-9cb0-2bfa58d5e815 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:07.307799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6ad575ad-e82f-400a-9cb0-2bfa58d5e815 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049751 Jul 04 06:01:07.308351 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 476/948] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:07.620698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6592b160-71a0-4ca0-b450-0b162cc285f9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:07.621732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6592b160-71a0-4ca0-b450-0b162cc285f9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:07.632612 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6592b160-71a0-4ca0-b450-0b162cc285f9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:07.633053 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6592b160-71a0-4ca0-b450-0b162cc285f9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:07.633806 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6592b160-71a0-4ca0-b450-0b162cc285f9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:07.634242 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6592b160-71a0-4ca0-b450-0b162cc285f9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:07.776430 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6592b160-71a0-4ca0-b450-0b162cc285f9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:07.784041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6592b160-71a0-4ca0-b450-0b162cc285f9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.170013 Jul 04 06:01:07.784590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 473/949] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:07 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:08.326065 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-88280fe9-cfac-4d5e-a072-7fcd179179c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:08.326916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-88280fe9-cfac-4d5e-a072-7fcd179179c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:08.333952 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88280fe9-cfac-4d5e-a072-7fcd179179c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:08.334414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88280fe9-cfac-4d5e-a072-7fcd179179c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:08.335210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88280fe9-cfac-4d5e-a072-7fcd179179c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:08.335680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88280fe9-cfac-4d5e-a072-7fcd179179c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:08.366242 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-88280fe9-cfac-4d5e-a072-7fcd179179c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050689 Jul 04 06:01:08.367076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 477/950] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:08 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:08.809737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb1a9eee-3e08-479b-83a9-cdb1df155214 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:08.810350 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb1a9eee-3e08-479b-83a9-cdb1df155214 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:08.817367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb1a9eee-3e08-479b-83a9-cdb1df155214 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:08.817769 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb1a9eee-3e08-479b-83a9-cdb1df155214 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:08.818554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb1a9eee-3e08-479b-83a9-cdb1df155214 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:08.818997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb1a9eee-3e08-479b-83a9-cdb1df155214 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:08.961780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb1a9eee-3e08-479b-83a9-cdb1df155214 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:08.969345 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb1a9eee-3e08-479b-83a9-cdb1df155214 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.172029 Jul 04 06:01:08.969901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 474/951] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:08 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:09.378273 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7139c164-1f4e-4100-bf42-b46ef1e4dcdb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:09.379203 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7139c164-1f4e-4100-bf42-b46ef1e4dcdb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:09.385957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7139c164-1f4e-4100-bf42-b46ef1e4dcdb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:09.386412 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7139c164-1f4e-4100-bf42-b46ef1e4dcdb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:09.387167 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7139c164-1f4e-4100-bf42-b46ef1e4dcdb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:09.387629 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7139c164-1f4e-4100-bf42-b46ef1e4dcdb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:09.417244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7139c164-1f4e-4100-bf42-b46ef1e4dcdb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042969 Jul 04 06:01:09.417788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 478/952] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:09.990886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-80e7f8ca-2929-4e45-8205-7971214fb0c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:09.991786 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-80e7f8ca-2929-4e45-8205-7971214fb0c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:09.999506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80e7f8ca-2929-4e45-8205-7971214fb0c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:09.999959 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80e7f8ca-2929-4e45-8205-7971214fb0c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:10.000736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80e7f8ca-2929-4e45-8205-7971214fb0c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:10.001178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80e7f8ca-2929-4e45-8205-7971214fb0c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:10.143884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-80e7f8ca-2929-4e45-8205-7971214fb0c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:10.151744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-80e7f8ca-2929-4e45-8205-7971214fb0c1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.167768 Jul 04 06:01:10.152416 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 475/953] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:09 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:10.429087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-08c5a5d7-d400-43ed-a434-f3f73b146f17 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:10.429902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-08c5a5d7-d400-43ed-a434-f3f73b146f17 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:10.436871 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08c5a5d7-d400-43ed-a434-f3f73b146f17 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:10.437324 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08c5a5d7-d400-43ed-a434-f3f73b146f17 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:10.438092 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08c5a5d7-d400-43ed-a434-f3f73b146f17 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:10.438526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08c5a5d7-d400-43ed-a434-f3f73b146f17 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:10.467957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-08c5a5d7-d400-43ed-a434-f3f73b146f17 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042944 Jul 04 06:01:10.468523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 479/954] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:10 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:11.173472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6eaf6ee7-66ce-4653-81d6-70e9a82853a2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:11.174304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6eaf6ee7-66ce-4653-81d6-70e9a82853a2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:11.185405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6eaf6ee7-66ce-4653-81d6-70e9a82853a2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:11.186148 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6eaf6ee7-66ce-4653-81d6-70e9a82853a2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:11.187472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6eaf6ee7-66ce-4653-81d6-70e9a82853a2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:11.188196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6eaf6ee7-66ce-4653-81d6-70e9a82853a2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:11.330689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6eaf6ee7-66ce-4653-81d6-70e9a82853a2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:11.338487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6eaf6ee7-66ce-4653-81d6-70e9a82853a2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.171657 Jul 04 06:01:11.339055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 476/955] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:11 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:11.483121 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e8c4ffa-d234-429b-bf09-555dea60ac97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:11.484663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e8c4ffa-d234-429b-bf09-555dea60ac97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:11.494401 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e8c4ffa-d234-429b-bf09-555dea60ac97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:11.494851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e8c4ffa-d234-429b-bf09-555dea60ac97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:11.495656 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e8c4ffa-d234-429b-bf09-555dea60ac97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:11.496088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e8c4ffa-d234-429b-bf09-555dea60ac97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:11.527367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e8c4ffa-d234-429b-bf09-555dea60ac97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050790 Jul 04 06:01:11.527936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 480/956] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:11 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:12.359674 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f3f4a038-bfb6-4f27-b7fb-1bb21de5cd0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:12.360725 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f3f4a038-bfb6-4f27-b7fb-1bb21de5cd0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:12.370208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3f4a038-bfb6-4f27-b7fb-1bb21de5cd0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:12.370665 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3f4a038-bfb6-4f27-b7fb-1bb21de5cd0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:12.371478 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3f4a038-bfb6-4f27-b7fb-1bb21de5cd0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:12.371912 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3f4a038-bfb6-4f27-b7fb-1bb21de5cd0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:12.520513 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f3f4a038-bfb6-4f27-b7fb-1bb21de5cd0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:12.528279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f3f4a038-bfb6-4f27-b7fb-1bb21de5cd0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.175252 Jul 04 06:01:12.528874 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 477/957] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:12 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:12.539939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9761c72c-19af-49f3-a062-80f644cea24b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:12.540867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9761c72c-19af-49f3-a062-80f644cea24b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:12.547538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9761c72c-19af-49f3-a062-80f644cea24b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:12.547987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9761c72c-19af-49f3-a062-80f644cea24b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:12.548739 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9761c72c-19af-49f3-a062-80f644cea24b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:12.549177 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9761c72c-19af-49f3-a062-80f644cea24b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:12.577866 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9761c72c-19af-49f3-a062-80f644cea24b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042784 Jul 04 06:01:12.578416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 481/958] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:12 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:13.546031 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d991cc4c-fca5-43d1-88da-8fe3398c7d90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:13.546645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d991cc4c-fca5-43d1-88da-8fe3398c7d90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:13.553637 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d991cc4c-fca5-43d1-88da-8fe3398c7d90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:13.554087 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d991cc4c-fca5-43d1-88da-8fe3398c7d90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:13.554858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d991cc4c-fca5-43d1-88da-8fe3398c7d90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:13.555277 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d991cc4c-fca5-43d1-88da-8fe3398c7d90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:13.589735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-038b3b91-8789-47bd-9c56-7655b235614f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:13.590752 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-038b3b91-8789-47bd-9c56-7655b235614f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:13.597529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-038b3b91-8789-47bd-9c56-7655b235614f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:13.598064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-038b3b91-8789-47bd-9c56-7655b235614f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:13.598891 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-038b3b91-8789-47bd-9c56-7655b235614f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:13.599335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-038b3b91-8789-47bd-9c56-7655b235614f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:13.629250 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-038b3b91-8789-47bd-9c56-7655b235614f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043458 Jul 04 06:01:13.629848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 482/959] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:13 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:13.690755 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d991cc4c-fca5-43d1-88da-8fe3398c7d90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:13.698333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d991cc4c-fca5-43d1-88da-8fe3398c7d90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.156262 Jul 04 06:01:13.699040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 478/960] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:13 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:14.645444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4510569-18b3-42c8-8030-29c304612124 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:14.646976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f4510569-18b3-42c8-8030-29c304612124 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:14.654546 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4510569-18b3-42c8-8030-29c304612124 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:14.654993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4510569-18b3-42c8-8030-29c304612124 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:14.655794 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4510569-18b3-42c8-8030-29c304612124 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:14.656225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4510569-18b3-42c8-8030-29c304612124 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:14.687029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f4510569-18b3-42c8-8030-29c304612124 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048299 Jul 04 06:01:14.687597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 483/961] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:14 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:14.715566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8ea290a-3be5-45cf-93cc-f282c98fb258 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:14.716178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8ea290a-3be5-45cf-93cc-f282c98fb258 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:14.723088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8ea290a-3be5-45cf-93cc-f282c98fb258 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:14.723577 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8ea290a-3be5-45cf-93cc-f282c98fb258 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:14.724356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8ea290a-3be5-45cf-93cc-f282c98fb258 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:14.724792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8ea290a-3be5-45cf-93cc-f282c98fb258 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:14.875811 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8ea290a-3be5-45cf-93cc-f282c98fb258 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:14.879261 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:14.883998 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8ea290a-3be5-45cf-93cc-f282c98fb258 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.172322 Jul 04 06:01:14.884615 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 479/962] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:14 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:15.703004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-441ed381-fa13-4e53-a600-690dbbcb8f09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:15.704549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-441ed381-fa13-4e53-a600-690dbbcb8f09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:15.715675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-441ed381-fa13-4e53-a600-690dbbcb8f09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:15.716428 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-441ed381-fa13-4e53-a600-690dbbcb8f09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:15.717694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-441ed381-fa13-4e53-a600-690dbbcb8f09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:15.718422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-441ed381-fa13-4e53-a600-690dbbcb8f09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:15.751085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-441ed381-fa13-4e53-a600-690dbbcb8f09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054669 Jul 04 06:01:15.751676 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 484/963] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:15.924419 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-86dcdf76-91dd-4227-b3c4-e11b9c6d0a13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:15.925317 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-86dcdf76-91dd-4227-b3c4-e11b9c6d0a13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:15.934103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86dcdf76-91dd-4227-b3c4-e11b9c6d0a13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:15.934550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86dcdf76-91dd-4227-b3c4-e11b9c6d0a13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:15.935313 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86dcdf76-91dd-4227-b3c4-e11b9c6d0a13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:15.935782 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86dcdf76-91dd-4227-b3c4-e11b9c6d0a13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:16.075102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-86dcdf76-91dd-4227-b3c4-e11b9c6d0a13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:16.082816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-86dcdf76-91dd-4227-b3c4-e11b9c6d0a13 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.165151 Jul 04 06:01:16.083669 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 480/964] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:15 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:16.766503 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a83664d3-684d-4a1f-a27f-ae6443656f64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:16.768026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a83664d3-684d-4a1f-a27f-ae6443656f64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:16.777360 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a83664d3-684d-4a1f-a27f-ae6443656f64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:16.777737 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a83664d3-684d-4a1f-a27f-ae6443656f64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:16.778493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a83664d3-684d-4a1f-a27f-ae6443656f64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:16.778919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a83664d3-684d-4a1f-a27f-ae6443656f64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:16.808868 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a83664d3-684d-4a1f-a27f-ae6443656f64 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048945 Jul 04 06:01:16.809394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 485/965] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:17.103440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2e4c6ba7-fd4a-4b2d-8d45-7d5d245ccec1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:17.104055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2e4c6ba7-fd4a-4b2d-8d45-7d5d245ccec1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:17.111541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e4c6ba7-fd4a-4b2d-8d45-7d5d245ccec1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:17.112047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e4c6ba7-fd4a-4b2d-8d45-7d5d245ccec1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:17.112889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e4c6ba7-fd4a-4b2d-8d45-7d5d245ccec1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:17.113373 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e4c6ba7-fd4a-4b2d-8d45-7d5d245ccec1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:17.259898 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2e4c6ba7-fd4a-4b2d-8d45-7d5d245ccec1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:17.267783 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2e4c6ba7-fd4a-4b2d-8d45-7d5d245ccec1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.170536 Jul 04 06:01:17.268472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 481/966] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:17 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:17.821191 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-be677583-ae85-47d9-a173-90b8d0dc908d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:17.822023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-be677583-ae85-47d9-a173-90b8d0dc908d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:17.828251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be677583-ae85-47d9-a173-90b8d0dc908d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:17.828699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be677583-ae85-47d9-a173-90b8d0dc908d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:17.829468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be677583-ae85-47d9-a173-90b8d0dc908d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:17.829898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be677583-ae85-47d9-a173-90b8d0dc908d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:17.859159 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-be677583-ae85-47d9-a173-90b8d0dc908d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042276 Jul 04 06:01:17.859749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 486/967] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:01:18.285203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2835b42f-eae8-40e4-b7c3-ba20d016f265 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:18.285824 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2835b42f-eae8-40e4-b7c3-ba20d016f265 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:18.292575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2835b42f-eae8-40e4-b7c3-ba20d016f265 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:18.293058 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2835b42f-eae8-40e4-b7c3-ba20d016f265 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:18.293837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2835b42f-eae8-40e4-b7c3-ba20d016f265 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:18.294278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2835b42f-eae8-40e4-b7c3-ba20d016f265 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:18.428010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2835b42f-eae8-40e4-b7c3-ba20d016f265 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:18.435652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2835b42f-eae8-40e4-b7c3-ba20d016f265 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.154608 Jul 04 06:01:18.436185 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 482/968] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:18 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:18.875096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-255a825c-a02a-4451-a7fd-89c7271cdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:18.876628 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-255a825c-a02a-4451-a7fd-89c7271cdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:18.880303 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:18.889168 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-255a825c-a02a-4451-a7fd-89c7271cdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:18.889926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-255a825c-a02a-4451-a7fd-89c7271cdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:18.891175 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-255a825c-a02a-4451-a7fd-89c7271cdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:18.891940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-255a825c-a02a-4451-a7fd-89c7271cdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:18.943426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-255a825c-a02a-4451-a7fd-89c7271cdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074685 Jul 04 06:01:18.943992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 487/969] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:19.458222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8b79a6eb-16d6-4229-8a80-0f14efc2ef7f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:19.458785 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8b79a6eb-16d6-4229-8a80-0f14efc2ef7f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:19.465485 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b79a6eb-16d6-4229-8a80-0f14efc2ef7f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:19.465927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b79a6eb-16d6-4229-8a80-0f14efc2ef7f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:19.466679 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b79a6eb-16d6-4229-8a80-0f14efc2ef7f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:19.467101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b79a6eb-16d6-4229-8a80-0f14efc2ef7f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:19.600894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8b79a6eb-16d6-4229-8a80-0f14efc2ef7f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:19.608449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8b79a6eb-16d6-4229-8a80-0f14efc2ef7f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1275 microversion: 2.1 time: 0.154250 Jul 04 06:01:19.609007 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 483/970] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:19 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:19.959742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b4318707-6e18-4b1e-b725-66b82fa98937 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:19.961121 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b4318707-6e18-4b1e-b725-66b82fa98937 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:19.968726 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4318707-6e18-4b1e-b725-66b82fa98937 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:19.969150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4318707-6e18-4b1e-b725-66b82fa98937 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:19.969956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4318707-6e18-4b1e-b725-66b82fa98937 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:19.970418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4318707-6e18-4b1e-b725-66b82fa98937 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:19.974265 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:20.000402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b4318707-6e18-4b1e-b725-66b82fa98937 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047513 Jul 04 06:01:20.000951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 488/971] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:20.626259 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1694356d-4323-4d66-8b87-b536ce1f2ada tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:20.626844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1694356d-4323-4d66-8b87-b536ce1f2ada tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:20.634194 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1694356d-4323-4d66-8b87-b536ce1f2ada tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:20.634568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1694356d-4323-4d66-8b87-b536ce1f2ada tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:20.635360 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1694356d-4323-4d66-8b87-b536ce1f2ada tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:20.635788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1694356d-4323-4d66-8b87-b536ce1f2ada tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:20.768927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1694356d-4323-4d66-8b87-b536ce1f2ada tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:20.776753 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1694356d-4323-4d66-8b87-b536ce1f2ada tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1219 microversion: 2.1 time: 0.154740 Jul 04 06:01:20.777314 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 484/972] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:20 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:20.961552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-6db138e4-c981-4175-a3ea-c3d4c2486df1 req-6d5ed196-0540-4f31-be85-f36d83157920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062c25e3-dd25-4cec-ba2c-b7c41f7103c4", "name": "network-vif-deleted", "tag": "9c38ad94-d258-4857-a072-c74d04ef81b9"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:01:20.970569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6db138e4-c981-4175-a3ea-c3d4c2486df1 req-6d5ed196-0540-4f31-be85-f36d83157920 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:20.971016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6db138e4-c981-4175-a3ea-c3d4c2486df1 req-6d5ed196-0540-4f31-be85-f36d83157920 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:20.983066 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.compute.server_external_events [req-6db138e4-c981-4175-a3ea-c3d4c2486df1 req-6d5ed196-0540-4f31-be85-f36d83157920 service nova] Unable to find a host for instance 062c25e3-dd25-4cec-ba2c-b7c41f7103c4. Dropping event network-vif-deleted {{(pid=117607) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 04 06:01:20.983860 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-6db138e4-c981-4175-a3ea-c3d4c2486df1 req-6d5ed196-0540-4f31-be85-f36d83157920 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.026196 Jul 04 06:01:20.984442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 489/973] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 04 06:01:21.012544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9774cf21-a642-43dd-ab61-00b54380fa95 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:21.013560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9774cf21-a642-43dd-ab61-00b54380fa95 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:21.022684 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9774cf21-a642-43dd-ab61-00b54380fa95 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:21.023134 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9774cf21-a642-43dd-ab61-00b54380fa95 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:21.024163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9774cf21-a642-43dd-ab61-00b54380fa95 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:21.024755 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9774cf21-a642-43dd-ab61-00b54380fa95 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:21.059527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9774cf21-a642-43dd-ab61-00b54380fa95 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051089 Jul 04 06:01:21.063692 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 485/974] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:21.795795 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4253ba6e-ce5c-4b8d-bf7c-b69f6078e5dd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:21.796600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4253ba6e-ce5c-4b8d-bf7c-b69f6078e5dd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:21.804938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4253ba6e-ce5c-4b8d-bf7c-b69f6078e5dd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:21.805533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4253ba6e-ce5c-4b8d-bf7c-b69f6078e5dd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:21.806551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4253ba6e-ce5c-4b8d-bf7c-b69f6078e5dd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:21.807128 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4253ba6e-ce5c-4b8d-bf7c-b69f6078e5dd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:21.874420 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4253ba6e-ce5c-4b8d-bf7c-b69f6078e5dd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:21.882042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4253ba6e-ce5c-4b8d-bf7c-b69f6078e5dd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091632 Jul 04 06:01:21.882851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 490/975] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:21 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:22.076016 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0f40329a-d594-44a6-8a08-52141ff0014c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:22.077434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0f40329a-d594-44a6-8a08-52141ff0014c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:22.088146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f40329a-d594-44a6-8a08-52141ff0014c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:22.088599 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f40329a-d594-44a6-8a08-52141ff0014c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:22.089372 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f40329a-d594-44a6-8a08-52141ff0014c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:22.089811 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f40329a-d594-44a6-8a08-52141ff0014c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:22.119561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0f40329a-d594-44a6-8a08-52141ff0014c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050350 Jul 04 06:01:22.120124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 486/976] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:22.901908 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-070303f7-c0f1-4970-9f3f-8b9079b3d29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:22.902460 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-070303f7-c0f1-4970-9f3f-8b9079b3d29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:22.909497 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-070303f7-c0f1-4970-9f3f-8b9079b3d29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:22.910312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-070303f7-c0f1-4970-9f3f-8b9079b3d29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:22.911108 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-070303f7-c0f1-4970-9f3f-8b9079b3d29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:22.911576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-070303f7-c0f1-4970-9f3f-8b9079b3d29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:22.975984 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-070303f7-c0f1-4970-9f3f-8b9079b3d29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:22.987920 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-070303f7-c0f1-4970-9f3f-8b9079b3d29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092196 Jul 04 06:01:22.989907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 491/977] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:22 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:23.134823 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2e02ca58-2031-4802-acad-d4276f6ab715 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:23.136444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2e02ca58-2031-4802-acad-d4276f6ab715 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:23.147810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e02ca58-2031-4802-acad-d4276f6ab715 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:23.148561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e02ca58-2031-4802-acad-d4276f6ab715 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:23.149822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e02ca58-2031-4802-acad-d4276f6ab715 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:23.150544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e02ca58-2031-4802-acad-d4276f6ab715 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:23.181341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2e02ca58-2031-4802-acad-d4276f6ab715 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053073 Jul 04 06:01:23.181812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 487/978] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:24.005483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e556a2d4-340d-4eb4-bc18-be070158cb94 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:24.006210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e556a2d4-340d-4eb4-bc18-be070158cb94 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:24.013382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e556a2d4-340d-4eb4-bc18-be070158cb94 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:24.013855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e556a2d4-340d-4eb4-bc18-be070158cb94 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:24.014637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e556a2d4-340d-4eb4-bc18-be070158cb94 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:24.015063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e556a2d4-340d-4eb4-bc18-be070158cb94 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:24.077074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e556a2d4-340d-4eb4-bc18-be070158cb94 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:24.084757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e556a2d4-340d-4eb4-bc18-be070158cb94 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.083174 Jul 04 06:01:24.085321 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 492/979] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:24 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:24.194525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a698e642-22eb-4e2b-a053-f820111a8304 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:24.195735 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a698e642-22eb-4e2b-a053-f820111a8304 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:24.204361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a698e642-22eb-4e2b-a053-f820111a8304 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:24.204907 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a698e642-22eb-4e2b-a053-f820111a8304 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:24.205862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a698e642-22eb-4e2b-a053-f820111a8304 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:24.206441 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a698e642-22eb-4e2b-a053-f820111a8304 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:24.238196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a698e642-22eb-4e2b-a053-f820111a8304 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048637 Jul 04 06:01:24.238749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 488/980] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:25.101647 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-613cc745-003c-4d0b-bbc7-ffffc9f5827d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:25.102278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-613cc745-003c-4d0b-bbc7-ffffc9f5827d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:25.109382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-613cc745-003c-4d0b-bbc7-ffffc9f5827d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:25.109835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-613cc745-003c-4d0b-bbc7-ffffc9f5827d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:25.110599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-613cc745-003c-4d0b-bbc7-ffffc9f5827d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:25.111034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-613cc745-003c-4d0b-bbc7-ffffc9f5827d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:25.175610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-613cc745-003c-4d0b-bbc7-ffffc9f5827d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:25.185612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-613cc745-003c-4d0b-bbc7-ffffc9f5827d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.087837 Jul 04 06:01:25.186184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 493/981] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:25 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:25.251142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb50658c-ee69-4ff8-bfac-711af5539543 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:25.252176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb50658c-ee69-4ff8-bfac-711af5539543 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:25.259795 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb50658c-ee69-4ff8-bfac-711af5539543 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:25.260289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb50658c-ee69-4ff8-bfac-711af5539543 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:25.261246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb50658c-ee69-4ff8-bfac-711af5539543 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:25.261669 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb50658c-ee69-4ff8-bfac-711af5539543 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:25.292263 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb50658c-ee69-4ff8-bfac-711af5539543 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045358 Jul 04 06:01:25.292818 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 489/982] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:01:26.206680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b8729677-bc85-454e-bd7a-45a67b7e97b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:26.207700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b8729677-bc85-454e-bd7a-45a67b7e97b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:26.218826 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8729677-bc85-454e-bd7a-45a67b7e97b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:26.219626 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8729677-bc85-454e-bd7a-45a67b7e97b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:26.220878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8729677-bc85-454e-bd7a-45a67b7e97b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:26.221585 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8729677-bc85-454e-bd7a-45a67b7e97b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:26.286747 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b8729677-bc85-454e-bd7a-45a67b7e97b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:26.298067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b8729677-bc85-454e-bd7a-45a67b7e97b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.097590 Jul 04 06:01:26.298653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 494/983] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:26 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:26.306006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d420d48f-0d78-4615-ac5e-db0a06529d33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:26.306983 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d420d48f-0d78-4615-ac5e-db0a06529d33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:26.309047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=56 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:26.316097 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d420d48f-0d78-4615-ac5e-db0a06529d33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:26.316551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d420d48f-0d78-4615-ac5e-db0a06529d33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:26.317316 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d420d48f-0d78-4615-ac5e-db0a06529d33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:26.317761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d420d48f-0d78-4615-ac5e-db0a06529d33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:26.347899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d420d48f-0d78-4615-ac5e-db0a06529d33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046570 Jul 04 06:01:26.348395 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 490/984] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:27.320975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-30b7da07-2d62-49bb-bef0-ceaa309ccb52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:27.321813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-30b7da07-2d62-49bb-bef0-ceaa309ccb52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:27.334993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30b7da07-2d62-49bb-bef0-ceaa309ccb52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:27.335807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30b7da07-2d62-49bb-bef0-ceaa309ccb52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:27.337086 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30b7da07-2d62-49bb-bef0-ceaa309ccb52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:27.337822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30b7da07-2d62-49bb-bef0-ceaa309ccb52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:27.359816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bbe327da-a5ca-48ac-aa1b-6c918f1aa638 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:27.360738 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bbe327da-a5ca-48ac-aa1b-6c918f1aa638 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:27.367228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbe327da-a5ca-48ac-aa1b-6c918f1aa638 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:27.367710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbe327da-a5ca-48ac-aa1b-6c918f1aa638 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:27.368563 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbe327da-a5ca-48ac-aa1b-6c918f1aa638 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:27.369024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbe327da-a5ca-48ac-aa1b-6c918f1aa638 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:27.398147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bbe327da-a5ca-48ac-aa1b-6c918f1aa638 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042264 Jul 04 06:01:27.398954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 491/985] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:27.399205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-30b7da07-2d62-49bb-bef0-ceaa309ccb52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:27.406994 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-30b7da07-2d62-49bb-bef0-ceaa309ccb52 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092566 Jul 04 06:01:27.407585 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 495/986] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:27 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:28.414915 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-acf4d8ef-27c5-4031-a2d2-3efe7b4a4a0e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:28.416346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-acf4d8ef-27c5-4031-a2d2-3efe7b4a4a0e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:28.423758 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acf4d8ef-27c5-4031-a2d2-3efe7b4a4a0e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:28.424208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acf4d8ef-27c5-4031-a2d2-3efe7b4a4a0e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:28.424378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-87adb5e4-d5da-45b6-95e5-d42074328377 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:28.424978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acf4d8ef-27c5-4031-a2d2-3efe7b4a4a0e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:28.425120 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-87adb5e4-d5da-45b6-95e5-d42074328377 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:28.425417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acf4d8ef-27c5-4031-a2d2-3efe7b4a4a0e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:28.431671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87adb5e4-d5da-45b6-95e5-d42074328377 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:28.432116 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87adb5e4-d5da-45b6-95e5-d42074328377 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:28.432973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87adb5e4-d5da-45b6-95e5-d42074328377 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:28.433421 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87adb5e4-d5da-45b6-95e5-d42074328377 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:28.456617 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-acf4d8ef-27c5-4031-a2d2-3efe7b4a4a0e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049287 Jul 04 06:01:28.457274 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 492/987] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:28.493725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-87adb5e4-d5da-45b6-95e5-d42074328377 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:28.501423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-87adb5e4-d5da-45b6-95e5-d42074328377 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.081089 Jul 04 06:01:28.501953 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 496/988] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:28 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:29.472241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42dfa7f5-ca5b-4ad0-84cc-f160bb54d0e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:29.473737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-42dfa7f5-ca5b-4ad0-84cc-f160bb54d0e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:29.484898 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42dfa7f5-ca5b-4ad0-84cc-f160bb54d0e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:29.485661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42dfa7f5-ca5b-4ad0-84cc-f160bb54d0e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:29.486920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42dfa7f5-ca5b-4ad0-84cc-f160bb54d0e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:29.487913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42dfa7f5-ca5b-4ad0-84cc-f160bb54d0e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:29.522297 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ce354f8-fa53-4d7e-9f9c-69d13dcabfcf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:29.522903 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-42dfa7f5-ca5b-4ad0-84cc-f160bb54d0e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057478 Jul 04 06:01:29.523000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8ce354f8-fa53-4d7e-9f9c-69d13dcabfcf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:29.526816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 493/989] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:29.530966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ce354f8-fa53-4d7e-9f9c-69d13dcabfcf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:29.531471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ce354f8-fa53-4d7e-9f9c-69d13dcabfcf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:29.532246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ce354f8-fa53-4d7e-9f9c-69d13dcabfcf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:29.532679 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ce354f8-fa53-4d7e-9f9c-69d13dcabfcf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:29.600919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ce354f8-fa53-4d7e-9f9c-69d13dcabfcf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:29.612012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ce354f8-fa53-4d7e-9f9c-69d13dcabfcf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.093563 Jul 04 06:01:29.612702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 497/990] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:29 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:30.535234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0c99c1be-1547-4448-a40d-0ba43977f3c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:30.536200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0c99c1be-1547-4448-a40d-0ba43977f3c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:30.543331 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c99c1be-1547-4448-a40d-0ba43977f3c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:30.543789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c99c1be-1547-4448-a40d-0ba43977f3c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:30.544567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c99c1be-1547-4448-a40d-0ba43977f3c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:30.545005 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c99c1be-1547-4448-a40d-0ba43977f3c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:30.574553 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0c99c1be-1547-4448-a40d-0ba43977f3c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Jul 04 06:01:30.575107 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 494/991] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:30 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:30.632442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a1fd88e7-94d9-4b79-a0da-7e7cdb653ad2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:30.632998 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1fd88e7-94d9-4b79-a0da-7e7cdb653ad2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:30.640112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1fd88e7-94d9-4b79-a0da-7e7cdb653ad2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:30.640564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1fd88e7-94d9-4b79-a0da-7e7cdb653ad2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:30.641335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1fd88e7-94d9-4b79-a0da-7e7cdb653ad2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:30.641775 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1fd88e7-94d9-4b79-a0da-7e7cdb653ad2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:30.701884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1fd88e7-94d9-4b79-a0da-7e7cdb653ad2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:30.709482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a1fd88e7-94d9-4b79-a0da-7e7cdb653ad2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.081102 Jul 04 06:01:30.710053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 498/992] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:30 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:31.590822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92fbaa84-232f-43fa-bdd0-a22783b8b182 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:31.591890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92fbaa84-232f-43fa-bdd0-a22783b8b182 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:31.599429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92fbaa84-232f-43fa-bdd0-a22783b8b182 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:31.599925 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92fbaa84-232f-43fa-bdd0-a22783b8b182 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:31.600770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92fbaa84-232f-43fa-bdd0-a22783b8b182 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:31.601246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92fbaa84-232f-43fa-bdd0-a22783b8b182 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:31.632901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92fbaa84-232f-43fa-bdd0-a22783b8b182 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048576 Jul 04 06:01:31.633447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 495/993] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:31 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:31.730415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-928f8ea4-9df0-43b1-8af0-ca3e15548c56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:31.731421 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-928f8ea4-9df0-43b1-8af0-ca3e15548c56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:31.742587 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-928f8ea4-9df0-43b1-8af0-ca3e15548c56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:31.743589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-928f8ea4-9df0-43b1-8af0-ca3e15548c56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:31.744726 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-928f8ea4-9df0-43b1-8af0-ca3e15548c56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:31.745458 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-928f8ea4-9df0-43b1-8af0-ca3e15548c56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:31.813984 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-928f8ea4-9df0-43b1-8af0-ca3e15548c56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:31.821866 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-928f8ea4-9df0-43b1-8af0-ca3e15548c56 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.098069 Jul 04 06:01:31.822444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 499/994] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:31 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:32.648847 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3d35a29c-85f3-4b37-83e1-c5bbc8d482e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:32.650186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3d35a29c-85f3-4b37-83e1-c5bbc8d482e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:32.657955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d35a29c-85f3-4b37-83e1-c5bbc8d482e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:32.658404 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d35a29c-85f3-4b37-83e1-c5bbc8d482e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:32.659163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d35a29c-85f3-4b37-83e1-c5bbc8d482e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:32.659973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d35a29c-85f3-4b37-83e1-c5bbc8d482e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:32.677227 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:32.690876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3d35a29c-85f3-4b37-83e1-c5bbc8d482e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048415 Jul 04 06:01:32.691381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 496/995] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:32 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:32.842248 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3c71e023-fd8b-42a3-9a95-cf4f5c8c2776 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:32.843313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3c71e023-fd8b-42a3-9a95-cf4f5c8c2776 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:32.854836 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c71e023-fd8b-42a3-9a95-cf4f5c8c2776 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:32.855795 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c71e023-fd8b-42a3-9a95-cf4f5c8c2776 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:32.856573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c71e023-fd8b-42a3-9a95-cf4f5c8c2776 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:32.857001 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c71e023-fd8b-42a3-9a95-cf4f5c8c2776 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:32.928625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3c71e023-fd8b-42a3-9a95-cf4f5c8c2776 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:32.936719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3c71e023-fd8b-42a3-9a95-cf4f5c8c2776 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.101087 Jul 04 06:01:32.937306 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 500/996] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:32 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:33.702901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-18d4225c-35e9-4a52-83bb-4f80d98f8889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:33.703847 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-18d4225c-35e9-4a52-83bb-4f80d98f8889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:33.710749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18d4225c-35e9-4a52-83bb-4f80d98f8889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:33.711188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18d4225c-35e9-4a52-83bb-4f80d98f8889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:33.711981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18d4225c-35e9-4a52-83bb-4f80d98f8889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:33.712407 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18d4225c-35e9-4a52-83bb-4f80d98f8889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:33.741771 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-18d4225c-35e9-4a52-83bb-4f80d98f8889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042951 Jul 04 06:01:33.742302 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 497/997] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:33.957602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ebf6dd89-ccf1-4308-8211-a7b0e1d3dd14 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:33.958622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ebf6dd89-ccf1-4308-8211-a7b0e1d3dd14 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:33.968185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ebf6dd89-ccf1-4308-8211-a7b0e1d3dd14 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:33.968633 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ebf6dd89-ccf1-4308-8211-a7b0e1d3dd14 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:33.969440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ebf6dd89-ccf1-4308-8211-a7b0e1d3dd14 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:33.969869 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ebf6dd89-ccf1-4308-8211-a7b0e1d3dd14 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:34.033812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ebf6dd89-ccf1-4308-8211-a7b0e1d3dd14 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:34.042070 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ebf6dd89-ccf1-4308-8211-a7b0e1d3dd14 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090929 Jul 04 06:01:34.042644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 501/998] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:33 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:34.758457 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d9d2a15f-99eb-4b7c-be69-716e825200c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:34.760183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d9d2a15f-99eb-4b7c-be69-716e825200c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:34.771536 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9d2a15f-99eb-4b7c-be69-716e825200c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:34.772180 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9d2a15f-99eb-4b7c-be69-716e825200c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:34.773480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9d2a15f-99eb-4b7c-be69-716e825200c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:34.774196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9d2a15f-99eb-4b7c-be69-716e825200c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:34.805591 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d9d2a15f-99eb-4b7c-be69-716e825200c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054372 Jul 04 06:01:34.806190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 498/999] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:35.066359 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ed93458-5de5-466f-8f20-f96f6380ce73 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:35.067490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8ed93458-5de5-466f-8f20-f96f6380ce73 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:35.078425 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ed93458-5de5-466f-8f20-f96f6380ce73 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:35.079160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ed93458-5de5-466f-8f20-f96f6380ce73 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:35.080492 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ed93458-5de5-466f-8f20-f96f6380ce73 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:35.081208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ed93458-5de5-466f-8f20-f96f6380ce73 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:35.399308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ed93458-5de5-466f-8f20-f96f6380ce73 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:35.408256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ed93458-5de5-466f-8f20-f96f6380ce73 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.350930 Jul 04 06:01:35.408816 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 502/1000] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:35 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:35.821583 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-278f9098-6e7c-437a-845d-68f3cbc85061 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:35.823064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-278f9098-6e7c-437a-845d-68f3cbc85061 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:35.831050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-278f9098-6e7c-437a-845d-68f3cbc85061 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:35.831517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-278f9098-6e7c-437a-845d-68f3cbc85061 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:35.832275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-278f9098-6e7c-437a-845d-68f3cbc85061 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:35.832700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-278f9098-6e7c-437a-845d-68f3cbc85061 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:35.861901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-278f9098-6e7c-437a-845d-68f3cbc85061 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047193 Jul 04 06:01:35.862439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 499/1001] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:36.430951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-88bd00ef-cc05-40c9-98ed-e5f80d059675 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:36.431921 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-88bd00ef-cc05-40c9-98ed-e5f80d059675 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:36.442906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88bd00ef-cc05-40c9-98ed-e5f80d059675 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:36.443720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88bd00ef-cc05-40c9-98ed-e5f80d059675 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:36.444996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88bd00ef-cc05-40c9-98ed-e5f80d059675 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:36.445725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88bd00ef-cc05-40c9-98ed-e5f80d059675 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:36.509577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-88bd00ef-cc05-40c9-98ed-e5f80d059675 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:36.517613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-88bd00ef-cc05-40c9-98ed-e5f80d059675 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.093243 Jul 04 06:01:36.518189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 503/1002] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:36 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:36.879443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8bfe29fd-93ae-4dd4-b437-6fdf6090dde4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:36.880951 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8bfe29fd-93ae-4dd4-b437-6fdf6090dde4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:36.891998 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bfe29fd-93ae-4dd4-b437-6fdf6090dde4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:36.892753 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bfe29fd-93ae-4dd4-b437-6fdf6090dde4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:36.894025 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bfe29fd-93ae-4dd4-b437-6fdf6090dde4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:36.894754 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bfe29fd-93ae-4dd4-b437-6fdf6090dde4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:36.927867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8bfe29fd-93ae-4dd4-b437-6fdf6090dde4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055096 Jul 04 06:01:36.928411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 500/1003] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:37.534443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ab2a3f95-491c-4b54-9924-e453b83a6898 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:37.535084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ab2a3f95-491c-4b54-9924-e453b83a6898 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:37.542168 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab2a3f95-491c-4b54-9924-e453b83a6898 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:37.542613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab2a3f95-491c-4b54-9924-e453b83a6898 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:37.543431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab2a3f95-491c-4b54-9924-e453b83a6898 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:37.544251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab2a3f95-491c-4b54-9924-e453b83a6898 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:37.612238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ab2a3f95-491c-4b54-9924-e453b83a6898 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:37.621114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ab2a3f95-491c-4b54-9924-e453b83a6898 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090858 Jul 04 06:01:37.621655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 504/1004] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:37 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:37.943822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5000aed2-c82e-4d25-9098-b75123da7c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:37.945213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5000aed2-c82e-4d25-9098-b75123da7c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:37.954028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5000aed2-c82e-4d25-9098-b75123da7c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:37.954484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5000aed2-c82e-4d25-9098-b75123da7c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:37.955271 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5000aed2-c82e-4d25-9098-b75123da7c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:37.955732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5000aed2-c82e-4d25-9098-b75123da7c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:37.984993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5000aed2-c82e-4d25-9098-b75123da7c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047913 Jul 04 06:01:37.985543 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 501/1005] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:38.641008 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e4c21473-ef21-4fea-85e3-889231959921 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:38.641539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e4c21473-ef21-4fea-85e3-889231959921 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:38.648420 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4c21473-ef21-4fea-85e3-889231959921 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:38.648872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4c21473-ef21-4fea-85e3-889231959921 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:38.649634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4c21473-ef21-4fea-85e3-889231959921 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:38.650068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4c21473-ef21-4fea-85e3-889231959921 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:38.668468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:38.711899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e4c21473-ef21-4fea-85e3-889231959921 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:38.719619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e4c21473-ef21-4fea-85e3-889231959921 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.084080 Jul 04 06:01:38.720183 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 505/1006] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:38 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:38.999745 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ed964257-9de0-479e-9baa-bd1f2a06ef32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:39.000683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ed964257-9de0-479e-9baa-bd1f2a06ef32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:39.007798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed964257-9de0-479e-9baa-bd1f2a06ef32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:39.008255 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed964257-9de0-479e-9baa-bd1f2a06ef32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:39.009023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed964257-9de0-479e-9baa-bd1f2a06ef32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:39.009463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed964257-9de0-479e-9baa-bd1f2a06ef32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:39.039357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ed964257-9de0-479e-9baa-bd1f2a06ef32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Jul 04 06:01:39.039899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 502/1007] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:39.740655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-883d153f-8559-4e7f-84e5-c70ae18f1337 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:39.741704 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-883d153f-8559-4e7f-84e5-c70ae18f1337 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:39.751651 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-883d153f-8559-4e7f-84e5-c70ae18f1337 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:39.752104 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-883d153f-8559-4e7f-84e5-c70ae18f1337 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:39.752877 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-883d153f-8559-4e7f-84e5-c70ae18f1337 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:39.753309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-883d153f-8559-4e7f-84e5-c70ae18f1337 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:39.826195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-883d153f-8559-4e7f-84e5-c70ae18f1337 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:39.835928 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-883d153f-8559-4e7f-84e5-c70ae18f1337 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.101738 Jul 04 06:01:39.836491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 506/1008] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:39 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:40.057081 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0e485902-2fc8-41fd-9fe1-d4cba4a15dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:40.058480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0e485902-2fc8-41fd-9fe1-d4cba4a15dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:40.066934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e485902-2fc8-41fd-9fe1-d4cba4a15dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:40.067410 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e485902-2fc8-41fd-9fe1-d4cba4a15dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:40.068181 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e485902-2fc8-41fd-9fe1-d4cba4a15dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:40.068616 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e485902-2fc8-41fd-9fe1-d4cba4a15dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:40.097567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0e485902-2fc8-41fd-9fe1-d4cba4a15dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047333 Jul 04 06:01:40.098112 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 503/1009] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:40.853220 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cfd56d8c-d9e5-4984-b6db-2e154da8eeba tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:40.853805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cfd56d8c-d9e5-4984-b6db-2e154da8eeba tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:40.860850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfd56d8c-d9e5-4984-b6db-2e154da8eeba tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:40.861296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfd56d8c-d9e5-4984-b6db-2e154da8eeba tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:40.862046 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfd56d8c-d9e5-4984-b6db-2e154da8eeba tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:40.862471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfd56d8c-d9e5-4984-b6db-2e154da8eeba tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:40.924063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cfd56d8c-d9e5-4984-b6db-2e154da8eeba tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:40.931797 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cfd56d8c-d9e5-4984-b6db-2e154da8eeba tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.082540 Jul 04 06:01:40.932358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 507/1010] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:40 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:41.118995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dae7a1bd-0d7d-400d-8190-341de053d175 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:41.120525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dae7a1bd-0d7d-400d-8190-341de053d175 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:41.128866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dae7a1bd-0d7d-400d-8190-341de053d175 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:41.129392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dae7a1bd-0d7d-400d-8190-341de053d175 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:41.130308 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dae7a1bd-0d7d-400d-8190-341de053d175 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:41.130816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dae7a1bd-0d7d-400d-8190-341de053d175 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:41.163067 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dae7a1bd-0d7d-400d-8190-341de053d175 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053041 Jul 04 06:01:41.163847 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 504/1011] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:41 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:41.948775 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-91ca1eec-5a8f-47af-9268-8c4e7f66e72f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:41.949378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-91ca1eec-5a8f-47af-9268-8c4e7f66e72f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:41.956024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91ca1eec-5a8f-47af-9268-8c4e7f66e72f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:41.956503 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91ca1eec-5a8f-47af-9268-8c4e7f66e72f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:41.957387 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91ca1eec-5a8f-47af-9268-8c4e7f66e72f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:41.957820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91ca1eec-5a8f-47af-9268-8c4e7f66e72f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:42.018156 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-91ca1eec-5a8f-47af-9268-8c4e7f66e72f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:42.025779 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-91ca1eec-5a8f-47af-9268-8c4e7f66e72f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.080911 Jul 04 06:01:42.026349 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 508/1012] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:41 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:42.179042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dfaaf53f-9997-4c52-b149-ca752902aba1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:42.180721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dfaaf53f-9997-4c52-b149-ca752902aba1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:42.190173 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfaaf53f-9997-4c52-b149-ca752902aba1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:42.190530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfaaf53f-9997-4c52-b149-ca752902aba1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:42.191282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfaaf53f-9997-4c52-b149-ca752902aba1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:42.191745 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfaaf53f-9997-4c52-b149-ca752902aba1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:42.222245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dfaaf53f-9997-4c52-b149-ca752902aba1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050116 Jul 04 06:01:42.222878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 505/1013] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:42 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:43.045671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b04750df-840e-415d-af62-0e5633e469f6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:43.046392 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b04750df-840e-415d-af62-0e5633e469f6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:43.056524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b04750df-840e-415d-af62-0e5633e469f6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:43.057208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b04750df-840e-415d-af62-0e5633e469f6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:43.058390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b04750df-840e-415d-af62-0e5633e469f6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:43.058978 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b04750df-840e-415d-af62-0e5633e469f6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:43.123886 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b04750df-840e-415d-af62-0e5633e469f6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:43.132048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b04750df-840e-415d-af62-0e5633e469f6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092907 Jul 04 06:01:43.132627 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 509/1014] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:43 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:43.235898 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9699f849-69fe-4ce0-bef0-5bac24a86e9e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:43.236825 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9699f849-69fe-4ce0-bef0-5bac24a86e9e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:43.244750 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9699f849-69fe-4ce0-bef0-5bac24a86e9e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:43.245321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9699f849-69fe-4ce0-bef0-5bac24a86e9e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:43.246610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9699f849-69fe-4ce0-bef0-5bac24a86e9e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:43.247208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9699f849-69fe-4ce0-bef0-5bac24a86e9e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:43.283398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9699f849-69fe-4ce0-bef0-5bac24a86e9e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052403 Jul 04 06:01:43.284276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 506/1015] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:44.149965 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ae1663e-71d9-4ec9-9235-586e190c765d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:44.150587 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ae1663e-71d9-4ec9-9235-586e190c765d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:44.158558 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ae1663e-71d9-4ec9-9235-586e190c765d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:44.159630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ae1663e-71d9-4ec9-9235-586e190c765d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:44.160525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ae1663e-71d9-4ec9-9235-586e190c765d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:44.161073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ae1663e-71d9-4ec9-9235-586e190c765d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:44.235644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ae1663e-71d9-4ec9-9235-586e190c765d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:44.244327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ae1663e-71d9-4ec9-9235-586e190c765d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.098950 Jul 04 06:01:44.244899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 510/1016] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:44 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:44.298055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e852373b-51b4-40fe-9812-b7aef16d36fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:44.299712 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e852373b-51b4-40fe-9812-b7aef16d36fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:44.309628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e852373b-51b4-40fe-9812-b7aef16d36fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:44.310263 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e852373b-51b4-40fe-9812-b7aef16d36fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:44.311381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e852373b-51b4-40fe-9812-b7aef16d36fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:44.311992 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e852373b-51b4-40fe-9812-b7aef16d36fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:44.341347 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e852373b-51b4-40fe-9812-b7aef16d36fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049010 Jul 04 06:01:44.341886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 507/1017] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:44 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:01:45.265069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-45e6f689-66f4-4f58-af58-ee46c241c6ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:45.266056 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-45e6f689-66f4-4f58-af58-ee46c241c6ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:45.277222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45e6f689-66f4-4f58-af58-ee46c241c6ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:45.277973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45e6f689-66f4-4f58-af58-ee46c241c6ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:45.279239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45e6f689-66f4-4f58-af58-ee46c241c6ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:45.279996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45e6f689-66f4-4f58-af58-ee46c241c6ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:45.341474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-45e6f689-66f4-4f58-af58-ee46c241c6ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:45.349132 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-45e6f689-66f4-4f58-af58-ee46c241c6ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090551 Jul 04 06:01:45.349702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 511/1018] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:45 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:45.353541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6c313b1b-7153-488c-8865-9892dc346c94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:45.354648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6c313b1b-7153-488c-8865-9892dc346c94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:45.362840 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c313b1b-7153-488c-8865-9892dc346c94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:45.363286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c313b1b-7153-488c-8865-9892dc346c94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:45.364077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c313b1b-7153-488c-8865-9892dc346c94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:45.364508 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c313b1b-7153-488c-8865-9892dc346c94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:45.395001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6c313b1b-7153-488c-8865-9892dc346c94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046514 Jul 04 06:01:45.395585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 508/1019] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:46.373476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b9e1ff2-09b9-4299-89f5-1bb7857ab34e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:46.374325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6b9e1ff2-09b9-4299-89f5-1bb7857ab34e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:46.385450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b9e1ff2-09b9-4299-89f5-1bb7857ab34e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:46.386193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b9e1ff2-09b9-4299-89f5-1bb7857ab34e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:46.387510 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b9e1ff2-09b9-4299-89f5-1bb7857ab34e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:46.388233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b9e1ff2-09b9-4299-89f5-1bb7857ab34e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:46.408587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5bdd837d-3301-4693-b5b7-150b297aeb87 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:46.409886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5bdd837d-3301-4693-b5b7-150b297aeb87 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:46.416391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bdd837d-3301-4693-b5b7-150b297aeb87 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:46.416842 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bdd837d-3301-4693-b5b7-150b297aeb87 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:46.417611 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bdd837d-3301-4693-b5b7-150b297aeb87 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:46.418051 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bdd837d-3301-4693-b5b7-150b297aeb87 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:46.448006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5bdd837d-3301-4693-b5b7-150b297aeb87 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043427 Jul 04 06:01:46.448581 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 509/1020] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:46 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:01:46.450019 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6b9e1ff2-09b9-4299-89f5-1bb7857ab34e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:46.457729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6b9e1ff2-09b9-4299-89f5-1bb7857ab34e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090992 Jul 04 06:01:46.458284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 512/1021] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:46 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:47.464250 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fbd0619d-199e-451e-af61-fa058267c9de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:47.465781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fbd0619d-199e-451e-af61-fa058267c9de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:47.473764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbd0619d-199e-451e-af61-fa058267c9de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:47.474139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbd0619d-199e-451e-af61-fa058267c9de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:47.474407 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f7983bab-3bfb-4cf5-b1fb-9e5669c1346f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:47.474851 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbd0619d-199e-451e-af61-fa058267c9de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:47.475029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f7983bab-3bfb-4cf5-b1fb-9e5669c1346f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:47.475372 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbd0619d-199e-451e-af61-fa058267c9de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:47.482099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7983bab-3bfb-4cf5-b1fb-9e5669c1346f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:47.482532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7983bab-3bfb-4cf5-b1fb-9e5669c1346f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:47.483341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7983bab-3bfb-4cf5-b1fb-9e5669c1346f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:47.483780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7983bab-3bfb-4cf5-b1fb-9e5669c1346f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:47.505761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fbd0619d-199e-451e-af61-fa058267c9de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048247 Jul 04 06:01:47.508631 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 510/1022] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:47.546083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f7983bab-3bfb-4cf5-b1fb-9e5669c1346f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:47.554085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f7983bab-3bfb-4cf5-b1fb-9e5669c1346f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.083568 Jul 04 06:01:47.554652 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 513/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:47 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:48.519322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2f9e89c7-b283-4ff5-9567-17ae4470af66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:48.519769 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2f9e89c7-b283-4ff5-9567-17ae4470af66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:48.526263 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f9e89c7-b283-4ff5-9567-17ae4470af66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:48.526713 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f9e89c7-b283-4ff5-9567-17ae4470af66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:48.527514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f9e89c7-b283-4ff5-9567-17ae4470af66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:48.527950 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f9e89c7-b283-4ff5-9567-17ae4470af66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:48.559567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2f9e89c7-b283-4ff5-9567-17ae4470af66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045566 Jul 04 06:01:48.560136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 511/1024] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:48.571077 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1e78e640-75a0-48f9-a8e7-701e48e9de22 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:48.571724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1e78e640-75a0-48f9-a8e7-701e48e9de22 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:48.580325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e78e640-75a0-48f9-a8e7-701e48e9de22 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:48.580863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e78e640-75a0-48f9-a8e7-701e48e9de22 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:48.581989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e78e640-75a0-48f9-a8e7-701e48e9de22 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:48.582739 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e78e640-75a0-48f9-a8e7-701e48e9de22 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:48.656740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1e78e640-75a0-48f9-a8e7-701e48e9de22 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:48.664817 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1e78e640-75a0-48f9-a8e7-701e48e9de22 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.097654 Jul 04 06:01:48.665386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 514/1025] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:48 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:49.575509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1655ea7b-48ca-4f3e-b125-02e483523ba7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:49.577092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1655ea7b-48ca-4f3e-b125-02e483523ba7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:49.588035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1655ea7b-48ca-4f3e-b125-02e483523ba7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:49.588768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1655ea7b-48ca-4f3e-b125-02e483523ba7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:49.590066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1655ea7b-48ca-4f3e-b125-02e483523ba7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:49.590790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1655ea7b-48ca-4f3e-b125-02e483523ba7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:49.621233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1655ea7b-48ca-4f3e-b125-02e483523ba7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052297 Jul 04 06:01:49.621773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 512/1026] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:49.685783 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b5bda646-a084-4619-8989-9d1bcf6070c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:49.686789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b5bda646-a084-4619-8989-9d1bcf6070c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:49.690561 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:49.698020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5bda646-a084-4619-8989-9d1bcf6070c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:49.698698 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5bda646-a084-4619-8989-9d1bcf6070c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:49.699963 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5bda646-a084-4619-8989-9d1bcf6070c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:49.700520 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5bda646-a084-4619-8989-9d1bcf6070c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:49.768500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b5bda646-a084-4619-8989-9d1bcf6070c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:49.780272 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b5bda646-a084-4619-8989-9d1bcf6070c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.100620 Jul 04 06:01:49.781128 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 515/1027] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:49 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:50.637688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bfd21838-35b4-4a08-b36c-02a21f4790f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:50.639185 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bfd21838-35b4-4a08-b36c-02a21f4790f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:50.646872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd21838-35b4-4a08-b36c-02a21f4790f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:50.647287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd21838-35b4-4a08-b36c-02a21f4790f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:50.648058 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd21838-35b4-4a08-b36c-02a21f4790f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:50.648497 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd21838-35b4-4a08-b36c-02a21f4790f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:50.652195 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:50.678423 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bfd21838-35b4-4a08-b36c-02a21f4790f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047541 Jul 04 06:01:50.678970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 513/1028] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:50 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:50.802042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f2b1a2c9-1303-4acf-95dd-62d4f0ef73af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:50.803040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f2b1a2c9-1303-4acf-95dd-62d4f0ef73af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:50.814236 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2b1a2c9-1303-4acf-95dd-62d4f0ef73af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:50.814990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2b1a2c9-1303-4acf-95dd-62d4f0ef73af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:50.816427 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2b1a2c9-1303-4acf-95dd-62d4f0ef73af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:50.817151 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2b1a2c9-1303-4acf-95dd-62d4f0ef73af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:50.881709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f2b1a2c9-1303-4acf-95dd-62d4f0ef73af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:50.889467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f2b1a2c9-1303-4acf-95dd-62d4f0ef73af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.093950 Jul 04 06:01:50.890225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 516/1029] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:50 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:51.692816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-15faaf9a-d3d4-4ea7-870f-e0431648c463 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:51.693935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-15faaf9a-d3d4-4ea7-870f-e0431648c463 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:51.702044 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15faaf9a-d3d4-4ea7-870f-e0431648c463 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:51.702506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15faaf9a-d3d4-4ea7-870f-e0431648c463 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:51.703459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15faaf9a-d3d4-4ea7-870f-e0431648c463 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:51.703978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15faaf9a-d3d4-4ea7-870f-e0431648c463 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:51.736262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-15faaf9a-d3d4-4ea7-870f-e0431648c463 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048166 Jul 04 06:01:51.736817 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 514/1030] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:51 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:51.911314 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-14dd0622-912b-440c-a513-586d1d87209f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:51.912340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-14dd0622-912b-440c-a513-586d1d87209f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:51.923340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14dd0622-912b-440c-a513-586d1d87209f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:51.924085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14dd0622-912b-440c-a513-586d1d87209f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:51.925371 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14dd0622-912b-440c-a513-586d1d87209f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:51.926102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-14dd0622-912b-440c-a513-586d1d87209f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:51.994197 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-14dd0622-912b-440c-a513-586d1d87209f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:52.002057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-14dd0622-912b-440c-a513-586d1d87209f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.097686 Jul 04 06:01:52.002653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 517/1031] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:51 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:52.752558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9279b0e0-e169-4c36-ac13-634a727c8f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:52.753922 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9279b0e0-e169-4c36-ac13-634a727c8f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:52.764839 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9279b0e0-e169-4c36-ac13-634a727c8f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:52.765585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9279b0e0-e169-4c36-ac13-634a727c8f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:52.766846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9279b0e0-e169-4c36-ac13-634a727c8f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:52.767634 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9279b0e0-e169-4c36-ac13-634a727c8f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:52.802918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9279b0e0-e169-4c36-ac13-634a727c8f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057406 Jul 04 06:01:52.803500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 515/1032] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:52 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:53.018880 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f616f968-8647-4521-ad2d-48b0e7d24a6c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:53.019540 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f616f968-8647-4521-ad2d-48b0e7d24a6c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:53.026450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f616f968-8647-4521-ad2d-48b0e7d24a6c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:53.026897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f616f968-8647-4521-ad2d-48b0e7d24a6c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:53.027704 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f616f968-8647-4521-ad2d-48b0e7d24a6c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:53.028135 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f616f968-8647-4521-ad2d-48b0e7d24a6c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:53.097499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f616f968-8647-4521-ad2d-48b0e7d24a6c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:53.107879 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f616f968-8647-4521-ad2d-48b0e7d24a6c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092748 Jul 04 06:01:53.108785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 518/1033] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:53 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:53.820912 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1080373d-8622-4102-9bc0-13b743aff1b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:53.822290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1080373d-8622-4102-9bc0-13b743aff1b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:53.831444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1080373d-8622-4102-9bc0-13b743aff1b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:53.831897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1080373d-8622-4102-9bc0-13b743aff1b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:53.832667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1080373d-8622-4102-9bc0-13b743aff1b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:53.833103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1080373d-8622-4102-9bc0-13b743aff1b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:53.865925 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1080373d-8622-4102-9bc0-13b743aff1b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051910 Jul 04 06:01:53.866475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 516/1034] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:53 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:54.128308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-63ba5b50-2c0d-445c-b34c-7e267cba6529 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:54.128975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-63ba5b50-2c0d-445c-b34c-7e267cba6529 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:54.135725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63ba5b50-2c0d-445c-b34c-7e267cba6529 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:54.136169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63ba5b50-2c0d-445c-b34c-7e267cba6529 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:54.136927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63ba5b50-2c0d-445c-b34c-7e267cba6529 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:54.137399 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63ba5b50-2c0d-445c-b34c-7e267cba6529 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:54.207957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-63ba5b50-2c0d-445c-b34c-7e267cba6529 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:54.218015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-63ba5b50-2c0d-445c-b34c-7e267cba6529 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.094673 Jul 04 06:01:54.218690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 519/1035] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:54 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:54.882776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b7a66a0-c915-4a92-ac93-7f41fdc65c79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:54.884395 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b7a66a0-c915-4a92-ac93-7f41fdc65c79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:54.895818 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b7a66a0-c915-4a92-ac93-7f41fdc65c79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:54.896563 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b7a66a0-c915-4a92-ac93-7f41fdc65c79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:54.897816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b7a66a0-c915-4a92-ac93-7f41fdc65c79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:54.898550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b7a66a0-c915-4a92-ac93-7f41fdc65c79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:54.932312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b7a66a0-c915-4a92-ac93-7f41fdc65c79 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056270 Jul 04 06:01:54.932773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 517/1036] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:55.243549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ebf0a62a-4d5a-425c-bf74-537c8a772e8c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:55.244308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ebf0a62a-4d5a-425c-bf74-537c8a772e8c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:55.254549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ebf0a62a-4d5a-425c-bf74-537c8a772e8c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:55.255314 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ebf0a62a-4d5a-425c-bf74-537c8a772e8c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:55.257948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ebf0a62a-4d5a-425c-bf74-537c8a772e8c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:55.257948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ebf0a62a-4d5a-425c-bf74-537c8a772e8c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:55.323209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ebf0a62a-4d5a-425c-bf74-537c8a772e8c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:55.331423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ebf0a62a-4d5a-425c-bf74-537c8a772e8c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092267 Jul 04 06:01:55.332161 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 520/1037] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:55 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:55.948557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ad42e35-6d84-490d-8026-967a4ecf0f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:55.949968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1ad42e35-6d84-490d-8026-967a4ecf0f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:55.957763 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ad42e35-6d84-490d-8026-967a4ecf0f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:55.958207 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ad42e35-6d84-490d-8026-967a4ecf0f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:55.958968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ad42e35-6d84-490d-8026-967a4ecf0f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:55.959401 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ad42e35-6d84-490d-8026-967a4ecf0f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:55.989267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ad42e35-6d84-490d-8026-967a4ecf0f29 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047650 Jul 04 06:01:55.989845 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 518/1038] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:56.349495 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7772951b-5204-4fa8-abd0-089719e0f9c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:56.350501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7772951b-5204-4fa8-abd0-089719e0f9c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:56.357565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7772951b-5204-4fa8-abd0-089719e0f9c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:56.357984 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7772951b-5204-4fa8-abd0-089719e0f9c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:56.358759 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7772951b-5204-4fa8-abd0-089719e0f9c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:56.359187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7772951b-5204-4fa8-abd0-089719e0f9c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:56.420654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7772951b-5204-4fa8-abd0-089719e0f9c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:56.428376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7772951b-5204-4fa8-abd0-089719e0f9c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.083121 Jul 04 06:01:56.428962 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 521/1039] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:56 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:57.003378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-af747ee4-1fc7-4811-ae07-10a6feddf479 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:57.004313 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-af747ee4-1fc7-4811-ae07-10a6feddf479 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:57.006880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=58 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:57.013081 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af747ee4-1fc7-4811-ae07-10a6feddf479 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:57.013613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af747ee4-1fc7-4811-ae07-10a6feddf479 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:57.014473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af747ee4-1fc7-4811-ae07-10a6feddf479 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:57.014962 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af747ee4-1fc7-4811-ae07-10a6feddf479 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:57.049490 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-af747ee4-1fc7-4811-ae07-10a6feddf479 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051858 Jul 04 06:01:57.050074 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 519/1040] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:56 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:57.444903 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3598417e-297d-422f-b727-a0e16a04562e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:57.445488 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3598417e-297d-422f-b727-a0e16a04562e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:57.452494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3598417e-297d-422f-b727-a0e16a04562e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:57.452949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3598417e-297d-422f-b727-a0e16a04562e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:57.453764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3598417e-297d-422f-b727-a0e16a04562e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:57.454184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3598417e-297d-422f-b727-a0e16a04562e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:57.458183 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:57.521196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3598417e-297d-422f-b727-a0e16a04562e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:57.528819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3598417e-297d-422f-b727-a0e16a04562e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.087794 Jul 04 06:01:57.529376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 522/1041] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:57 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:58.063128 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8290985a-55b1-4f6f-8087-7f6f399e5bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:58.064118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8290985a-55b1-4f6f-8087-7f6f399e5bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:58.072236 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8290985a-55b1-4f6f-8087-7f6f399e5bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:58.072759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8290985a-55b1-4f6f-8087-7f6f399e5bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:58.073638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8290985a-55b1-4f6f-8087-7f6f399e5bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:58.074143 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8290985a-55b1-4f6f-8087-7f6f399e5bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:58.105025 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8290985a-55b1-4f6f-8087-7f6f399e5bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047032 Jul 04 06:01:58.105587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 520/1042] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:58.545921 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-35cf5c32-ba0a-4489-a88b-c8734860b0a5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:58.546539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-35cf5c32-ba0a-4489-a88b-c8734860b0a5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:58.553443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35cf5c32-ba0a-4489-a88b-c8734860b0a5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:58.553892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35cf5c32-ba0a-4489-a88b-c8734860b0a5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:58.554659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35cf5c32-ba0a-4489-a88b-c8734860b0a5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:58.555097 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35cf5c32-ba0a-4489-a88b-c8734860b0a5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:58.618659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-35cf5c32-ba0a-4489-a88b-c8734860b0a5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:58.626394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-35cf5c32-ba0a-4489-a88b-c8734860b0a5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.084371 Jul 04 06:01:58.627179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 523/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:58 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:01:59.121139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63a04d12-b706-43fe-b133-ede24aa9dd2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:59.122479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63a04d12-b706-43fe-b133-ede24aa9dd2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:59.133816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63a04d12-b706-43fe-b133-ede24aa9dd2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:59.134546 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63a04d12-b706-43fe-b133-ede24aa9dd2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:59.135953 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63a04d12-b706-43fe-b133-ede24aa9dd2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:59.136667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63a04d12-b706-43fe-b133-ede24aa9dd2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:59.170497 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63a04d12-b706-43fe-b133-ede24aa9dd2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055775 Jul 04 06:01:59.171312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 521/1044] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:01:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:01:59.644239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4418683c-ee51-433c-ae06-e6a08eaa221b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:01:59.644809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4418683c-ee51-433c-ae06-e6a08eaa221b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:01:59.652189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4418683c-ee51-433c-ae06-e6a08eaa221b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:59.652642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4418683c-ee51-433c-ae06-e6a08eaa221b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:59.653407 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4418683c-ee51-433c-ae06-e6a08eaa221b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:01:59.653845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4418683c-ee51-433c-ae06-e6a08eaa221b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:01:59.721570 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4418683c-ee51-433c-ae06-e6a08eaa221b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:01:59.733438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4418683c-ee51-433c-ae06-e6a08eaa221b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.093215 Jul 04 06:01:59.734151 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 524/1045] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:01:59 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:00.188975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fb0ede8c-970a-4632-86dd-871dce7a13e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:00.189844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fb0ede8c-970a-4632-86dd-871dce7a13e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:00.196619 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb0ede8c-970a-4632-86dd-871dce7a13e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:00.197060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb0ede8c-970a-4632-86dd-871dce7a13e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:00.197835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb0ede8c-970a-4632-86dd-871dce7a13e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:00.198268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb0ede8c-970a-4632-86dd-871dce7a13e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:00.227290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fb0ede8c-970a-4632-86dd-871dce7a13e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045424 Jul 04 06:02:00.227827 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 522/1046] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:00 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:00.754989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1456a92a-ff03-4277-9032-3a1a7db3fdf1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:00.756040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1456a92a-ff03-4277-9032-3a1a7db3fdf1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:00.766940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1456a92a-ff03-4277-9032-3a1a7db3fdf1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:00.767744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1456a92a-ff03-4277-9032-3a1a7db3fdf1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:00.769014 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1456a92a-ff03-4277-9032-3a1a7db3fdf1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:00.769753 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1456a92a-ff03-4277-9032-3a1a7db3fdf1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:00.835881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1456a92a-ff03-4277-9032-3a1a7db3fdf1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:00.843970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1456a92a-ff03-4277-9032-3a1a7db3fdf1 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.095684 Jul 04 06:02:00.844547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 525/1047] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:00 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:01.243453 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e449b193-001c-4af1-88fa-844964714898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:01.244995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e449b193-001c-4af1-88fa-844964714898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:01.256004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e449b193-001c-4af1-88fa-844964714898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:01.256757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e449b193-001c-4af1-88fa-844964714898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:01.258073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e449b193-001c-4af1-88fa-844964714898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:01.258768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e449b193-001c-4af1-88fa-844964714898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:01.292780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e449b193-001c-4af1-88fa-844964714898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056069 Jul 04 06:02:01.293334 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 523/1048] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:01 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:01.863760 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-36b03b90-4dfc-492f-938c-ef45e3749058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:01.864367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-36b03b90-4dfc-492f-938c-ef45e3749058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:01.871274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36b03b90-4dfc-492f-938c-ef45e3749058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:01.871737 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36b03b90-4dfc-492f-938c-ef45e3749058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:01.872506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36b03b90-4dfc-492f-938c-ef45e3749058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:01.872938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36b03b90-4dfc-492f-938c-ef45e3749058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:01.943068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36b03b90-4dfc-492f-938c-ef45e3749058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:01.950863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-36b03b90-4dfc-492f-938c-ef45e3749058 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092438 Jul 04 06:02:01.951458 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 526/1049] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:01 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:02.309101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fbe21ae0-6423-4138-aac7-1c1188e32e57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:02.310614 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fbe21ae0-6423-4138-aac7-1c1188e32e57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:02.319585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbe21ae0-6423-4138-aac7-1c1188e32e57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:02.320035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbe21ae0-6423-4138-aac7-1c1188e32e57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:02.320813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbe21ae0-6423-4138-aac7-1c1188e32e57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:02.321247 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbe21ae0-6423-4138-aac7-1c1188e32e57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:02.351647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fbe21ae0-6423-4138-aac7-1c1188e32e57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049439 Jul 04 06:02:02.352194 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 524/1050] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:02 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:02.971205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ec2a84e3-cb0e-4e07-9ea0-e042382da084 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:02.972311 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ec2a84e3-cb0e-4e07-9ea0-e042382da084 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:02.980410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec2a84e3-cb0e-4e07-9ea0-e042382da084 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:02.980880 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec2a84e3-cb0e-4e07-9ea0-e042382da084 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:02.981740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec2a84e3-cb0e-4e07-9ea0-e042382da084 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:02.982558 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec2a84e3-cb0e-4e07-9ea0-e042382da084 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:03.047525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ec2a84e3-cb0e-4e07-9ea0-e042382da084 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:03.055588 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ec2a84e3-cb0e-4e07-9ea0-e042382da084 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090834 Jul 04 06:02:03.056147 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 527/1051] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:02 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:03.365953 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a355c296-b916-4549-ab14-193b103e2316 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:03.366781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a355c296-b916-4549-ab14-193b103e2316 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:03.374006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a355c296-b916-4549-ab14-193b103e2316 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:03.374478 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a355c296-b916-4549-ab14-193b103e2316 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:03.375241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a355c296-b916-4549-ab14-193b103e2316 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:03.375690 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a355c296-b916-4549-ab14-193b103e2316 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:03.406117 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a355c296-b916-4549-ab14-193b103e2316 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045072 Jul 04 06:02:03.406665 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 525/1052] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:04.077828 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d2fa927a-c2ef-402c-b358-232eaf87be49 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:04.078600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d2fa927a-c2ef-402c-b358-232eaf87be49 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:04.086356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2fa927a-c2ef-402c-b358-232eaf87be49 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:04.086807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2fa927a-c2ef-402c-b358-232eaf87be49 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:04.087605 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2fa927a-c2ef-402c-b358-232eaf87be49 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:04.088037 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2fa927a-c2ef-402c-b358-232eaf87be49 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:04.156432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d2fa927a-c2ef-402c-b358-232eaf87be49 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:04.164800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d2fa927a-c2ef-402c-b358-232eaf87be49 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092159 Jul 04 06:02:04.165378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 528/1053] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:04 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:04.422387 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c55a6c91-0ecf-4513-a888-16d8e9a095a3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:04.423807 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c55a6c91-0ecf-4513-a888-16d8e9a095a3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:04.434761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c55a6c91-0ecf-4513-a888-16d8e9a095a3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:04.435582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c55a6c91-0ecf-4513-a888-16d8e9a095a3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:04.436849 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c55a6c91-0ecf-4513-a888-16d8e9a095a3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:04.437587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c55a6c91-0ecf-4513-a888-16d8e9a095a3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:04.468446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c55a6c91-0ecf-4513-a888-16d8e9a095a3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052905 Jul 04 06:02:04.469001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 526/1054] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:05.185477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3fa2add5-d01e-4a30-b672-d9ee6d48260d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:05.186242 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3fa2add5-d01e-4a30-b672-d9ee6d48260d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:05.193521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fa2add5-d01e-4a30-b672-d9ee6d48260d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:05.193997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fa2add5-d01e-4a30-b672-d9ee6d48260d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:05.194702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fa2add5-d01e-4a30-b672-d9ee6d48260d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:05.195131 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fa2add5-d01e-4a30-b672-d9ee6d48260d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:05.255352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3fa2add5-d01e-4a30-b672-d9ee6d48260d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:05.262949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3fa2add5-d01e-4a30-b672-d9ee6d48260d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.084496 Jul 04 06:02:05.263549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 529/1055] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:05 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:05.484881 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bdd133a6-9df0-4b50-8a03-6b47e8210a0f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:05.486408 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bdd133a6-9df0-4b50-8a03-6b47e8210a0f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:05.494413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdd133a6-9df0-4b50-8a03-6b47e8210a0f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:05.494860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdd133a6-9df0-4b50-8a03-6b47e8210a0f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:05.495656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdd133a6-9df0-4b50-8a03-6b47e8210a0f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:05.496182 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdd133a6-9df0-4b50-8a03-6b47e8210a0f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:05.526143 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bdd133a6-9df0-4b50-8a03-6b47e8210a0f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047881 Jul 04 06:02:05.526679 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 527/1056] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:05 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:06.279949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a77434a-dc43-493d-a827-f6351eaa2c6f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:06.280557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a77434a-dc43-493d-a827-f6351eaa2c6f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:06.288518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a77434a-dc43-493d-a827-f6351eaa2c6f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:06.288845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a77434a-dc43-493d-a827-f6351eaa2c6f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:06.289608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a77434a-dc43-493d-a827-f6351eaa2c6f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:06.290036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a77434a-dc43-493d-a827-f6351eaa2c6f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:06.369029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1a77434a-dc43-493d-a827-f6351eaa2c6f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:06.369029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a77434a-dc43-493d-a827-f6351eaa2c6f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.088892 Jul 04 06:02:06.369029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 530/1057] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:06 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:06.538655 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e657a7a6-a399-4f71-8c03-bdae343effcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:06.539620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e657a7a6-a399-4f71-8c03-bdae343effcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:06.546696 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e657a7a6-a399-4f71-8c03-bdae343effcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:06.547147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e657a7a6-a399-4f71-8c03-bdae343effcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:06.547943 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e657a7a6-a399-4f71-8c03-bdae343effcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:06.548377 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e657a7a6-a399-4f71-8c03-bdae343effcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:06.577290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e657a7a6-a399-4f71-8c03-bdae343effcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042675 Jul 04 06:02:06.577831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 528/1058] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:07.384048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e72526a9-ec1f-48bb-b665-b2d5d8ed28ad tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:07.384987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e72526a9-ec1f-48bb-b665-b2d5d8ed28ad tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:07.392325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e72526a9-ec1f-48bb-b665-b2d5d8ed28ad tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:07.392818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e72526a9-ec1f-48bb-b665-b2d5d8ed28ad tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:07.393676 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e72526a9-ec1f-48bb-b665-b2d5d8ed28ad tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:07.394154 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e72526a9-ec1f-48bb-b665-b2d5d8ed28ad tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:07.461956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e72526a9-ec1f-48bb-b665-b2d5d8ed28ad tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:07.470129 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e72526a9-ec1f-48bb-b665-b2d5d8ed28ad tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090262 Jul 04 06:02:07.470704 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 531/1059] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:07 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:07.593342 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-411d4b85-1ad4-47f6-9c53-26601451a7ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:07.594412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-411d4b85-1ad4-47f6-9c53-26601451a7ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:07.602456 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-411d4b85-1ad4-47f6-9c53-26601451a7ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:07.602901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-411d4b85-1ad4-47f6-9c53-26601451a7ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:07.603710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-411d4b85-1ad4-47f6-9c53-26601451a7ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:07.604142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-411d4b85-1ad4-47f6-9c53-26601451a7ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:07.630342 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:07.639923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-411d4b85-1ad4-47f6-9c53-26601451a7ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052578 Jul 04 06:02:07.640840 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 529/1060] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:08.490579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-24fd9a8a-e43c-4637-b457-e34b8614c364 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:08.491469 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-24fd9a8a-e43c-4637-b457-e34b8614c364 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:08.500544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24fd9a8a-e43c-4637-b457-e34b8614c364 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:08.501175 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24fd9a8a-e43c-4637-b457-e34b8614c364 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:08.502166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24fd9a8a-e43c-4637-b457-e34b8614c364 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:08.502786 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24fd9a8a-e43c-4637-b457-e34b8614c364 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:08.568745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-24fd9a8a-e43c-4637-b457-e34b8614c364 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:08.578248 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-24fd9a8a-e43c-4637-b457-e34b8614c364 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.093896 Jul 04 06:02:08.578844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 532/1061] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:08 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:08.653894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6cd43e2c-238b-4a40-b1ee-f520dc4fcbad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:08.655017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6cd43e2c-238b-4a40-b1ee-f520dc4fcbad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:08.664998 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cd43e2c-238b-4a40-b1ee-f520dc4fcbad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:08.665605 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cd43e2c-238b-4a40-b1ee-f520dc4fcbad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:08.666705 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cd43e2c-238b-4a40-b1ee-f520dc4fcbad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:08.667313 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cd43e2c-238b-4a40-b1ee-f520dc4fcbad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:08.703974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6cd43e2c-238b-4a40-b1ee-f520dc4fcbad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055491 Jul 04 06:02:08.704538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 530/1062] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:08 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:09.595683 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6feee539-694e-40b5-9e23-887034506ed0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:09.596281 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6feee539-694e-40b5-9e23-887034506ed0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:09.603098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6feee539-694e-40b5-9e23-887034506ed0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:09.603589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6feee539-694e-40b5-9e23-887034506ed0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:09.604360 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6feee539-694e-40b5-9e23-887034506ed0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:09.604796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6feee539-694e-40b5-9e23-887034506ed0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:09.682745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6feee539-694e-40b5-9e23-887034506ed0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:09.691589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6feee539-694e-40b5-9e23-887034506ed0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.099047 Jul 04 06:02:09.692488 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 533/1063] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:09 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:09.715988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-02669b66-b97d-43f4-94b2-d252a1e2fc31 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:09.716915 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-02669b66-b97d-43f4-94b2-d252a1e2fc31 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:09.723982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02669b66-b97d-43f4-94b2-d252a1e2fc31 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:09.724431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02669b66-b97d-43f4-94b2-d252a1e2fc31 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:09.725185 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02669b66-b97d-43f4-94b2-d252a1e2fc31 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:09.725618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02669b66-b97d-43f4-94b2-d252a1e2fc31 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:09.755835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-02669b66-b97d-43f4-94b2-d252a1e2fc31 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Jul 04 06:02:09.756382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 531/1064] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:10.711094 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-68977f99-bb6a-4ad9-911a-647622b96c90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:10.711732 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-68977f99-bb6a-4ad9-911a-647622b96c90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:10.718461 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68977f99-bb6a-4ad9-911a-647622b96c90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:10.718917 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68977f99-bb6a-4ad9-911a-647622b96c90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:10.719695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68977f99-bb6a-4ad9-911a-647622b96c90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:10.720122 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68977f99-bb6a-4ad9-911a-647622b96c90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:10.768278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-38dcf27f-f5e9-45e5-b409-c7b7c3a4503a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:10.769240 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-38dcf27f-f5e9-45e5-b409-c7b7c3a4503a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:10.780451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38dcf27f-f5e9-45e5-b409-c7b7c3a4503a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:10.783830 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38dcf27f-f5e9-45e5-b409-c7b7c3a4503a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:10.784360 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38dcf27f-f5e9-45e5-b409-c7b7c3a4503a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:10.784803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38dcf27f-f5e9-45e5-b409-c7b7c3a4503a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:10.786655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68977f99-bb6a-4ad9-911a-647622b96c90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:10.794465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-68977f99-bb6a-4ad9-911a-647622b96c90 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.088019 Jul 04 06:02:10.795064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 534/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:10 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:10.816198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-38dcf27f-f5e9-45e5-b409-c7b7c3a4503a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051934 Jul 04 06:02:10.816783 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 532/1066] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:10 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:11.818130 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0a1b85c-f908-404d-a83c-dbf681f10ba2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:11.818809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c0a1b85c-f908-404d-a83c-dbf681f10ba2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:11.825381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0a1b85c-f908-404d-a83c-dbf681f10ba2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:11.826227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0a1b85c-f908-404d-a83c-dbf681f10ba2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:11.826990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0a1b85c-f908-404d-a83c-dbf681f10ba2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:11.827493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0a1b85c-f908-404d-a83c-dbf681f10ba2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:11.833100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-91dceec6-5a04-47b1-ae31-b0c1baa31ff7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:11.834919 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-91dceec6-5a04-47b1-ae31-b0c1baa31ff7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:11.842505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91dceec6-5a04-47b1-ae31-b0c1baa31ff7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:11.843040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91dceec6-5a04-47b1-ae31-b0c1baa31ff7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:11.844135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91dceec6-5a04-47b1-ae31-b0c1baa31ff7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:11.844641 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91dceec6-5a04-47b1-ae31-b0c1baa31ff7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:11.883413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-91dceec6-5a04-47b1-ae31-b0c1baa31ff7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058500 Jul 04 06:02:11.883975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 533/1067] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:11 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:11.901296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c0a1b85c-f908-404d-a83c-dbf681f10ba2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:11.912631 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c0a1b85c-f908-404d-a83c-dbf681f10ba2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.103119 Jul 04 06:02:11.913203 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 535/1068] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:11 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:12.894470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4bb62b7-bf91-468c-a893-7a07038c836e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:12.895407 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c4bb62b7-bf91-468c-a893-7a07038c836e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:12.902709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4bb62b7-bf91-468c-a893-7a07038c836e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:12.903165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4bb62b7-bf91-468c-a893-7a07038c836e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:12.903968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4bb62b7-bf91-468c-a893-7a07038c836e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:12.904405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4bb62b7-bf91-468c-a893-7a07038c836e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:12.930180 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-97a6333f-538a-4f82-b900-b1f33cbac129 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:12.930757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-97a6333f-538a-4f82-b900-b1f33cbac129 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:12.935339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c4bb62b7-bf91-468c-a893-7a07038c836e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044917 Jul 04 06:02:12.936160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 534/1069] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:12 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:12.937606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97a6333f-538a-4f82-b900-b1f33cbac129 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:12.938058 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97a6333f-538a-4f82-b900-b1f33cbac129 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:12.938829 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97a6333f-538a-4f82-b900-b1f33cbac129 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:12.939283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97a6333f-538a-4f82-b900-b1f33cbac129 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:13.007661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-97a6333f-538a-4f82-b900-b1f33cbac129 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:13.015747 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-97a6333f-538a-4f82-b900-b1f33cbac129 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.089484 Jul 04 06:02:13.016308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 536/1070] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:12 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:13.950343 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cfaea31d-21f3-46e7-8459-1ea7f7eb70bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:13.951733 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cfaea31d-21f3-46e7-8459-1ea7f7eb70bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:13.960881 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfaea31d-21f3-46e7-8459-1ea7f7eb70bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:13.961356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfaea31d-21f3-46e7-8459-1ea7f7eb70bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:13.962127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfaea31d-21f3-46e7-8459-1ea7f7eb70bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:13.962565 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfaea31d-21f3-46e7-8459-1ea7f7eb70bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:13.991888 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cfaea31d-21f3-46e7-8459-1ea7f7eb70bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048590 Jul 04 06:02:13.992438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 535/1071] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:13 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:14.032981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2354f90a-a535-4007-b3f4-979d2bcfb29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:14.033664 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2354f90a-a535-4007-b3f4-979d2bcfb29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:14.040769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2354f90a-a535-4007-b3f4-979d2bcfb29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:14.041193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2354f90a-a535-4007-b3f4-979d2bcfb29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:14.042030 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2354f90a-a535-4007-b3f4-979d2bcfb29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:14.042465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2354f90a-a535-4007-b3f4-979d2bcfb29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:14.114508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2354f90a-a535-4007-b3f4-979d2bcfb29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:14.122490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2354f90a-a535-4007-b3f4-979d2bcfb29e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.093808 Jul 04 06:02:14.123066 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 537/1072] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:14 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:15.009706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f4f22dcd-c803-4cfe-ad29-34cced144456 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:15.011213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f4f22dcd-c803-4cfe-ad29-34cced144456 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:15.022254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4f22dcd-c803-4cfe-ad29-34cced144456 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:15.023006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4f22dcd-c803-4cfe-ad29-34cced144456 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:15.024343 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4f22dcd-c803-4cfe-ad29-34cced144456 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:15.025065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4f22dcd-c803-4cfe-ad29-34cced144456 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:15.059539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f4f22dcd-c803-4cfe-ad29-34cced144456 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056599 Jul 04 06:02:15.060088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 536/1073] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:15.143497 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-25562b40-361e-48a6-a446-6ef823fda316 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:15.144444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-25562b40-361e-48a6-a446-6ef823fda316 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:15.151970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25562b40-361e-48a6-a446-6ef823fda316 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:15.152424 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25562b40-361e-48a6-a446-6ef823fda316 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:15.153192 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25562b40-361e-48a6-a446-6ef823fda316 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:15.153628 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25562b40-361e-48a6-a446-6ef823fda316 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:15.216255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-25562b40-361e-48a6-a446-6ef823fda316 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:15.221021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:15.227658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-25562b40-361e-48a6-a446-6ef823fda316 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090255 Jul 04 06:02:15.228390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 538/1074] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:15 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:16.074154 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b4478aa0-4f90-47ac-8c94-7a3cc829433b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:16.075101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b4478aa0-4f90-47ac-8c94-7a3cc829433b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:16.085160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4478aa0-4f90-47ac-8c94-7a3cc829433b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:16.085612 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4478aa0-4f90-47ac-8c94-7a3cc829433b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:16.086385 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4478aa0-4f90-47ac-8c94-7a3cc829433b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:16.086823 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4478aa0-4f90-47ac-8c94-7a3cc829433b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:16.116310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b4478aa0-4f90-47ac-8c94-7a3cc829433b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048337 Jul 04 06:02:16.116863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 537/1075] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:16.247216 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-806f84c8-e387-427a-83d7-e0cfc4e31403 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:16.248262 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-806f84c8-e387-427a-83d7-e0cfc4e31403 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:16.258273 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-806f84c8-e387-427a-83d7-e0cfc4e31403 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:16.258726 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-806f84c8-e387-427a-83d7-e0cfc4e31403 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:16.259529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-806f84c8-e387-427a-83d7-e0cfc4e31403 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:16.259967 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-806f84c8-e387-427a-83d7-e0cfc4e31403 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:16.321790 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-806f84c8-e387-427a-83d7-e0cfc4e31403 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:16.329684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-806f84c8-e387-427a-83d7-e0cfc4e31403 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.088345 Jul 04 06:02:16.330185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 539/1076] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:16 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:17.132040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2deb4999-cb73-44f2-87b1-85d32269e32e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:17.132878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2deb4999-cb73-44f2-87b1-85d32269e32e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:17.139836 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2deb4999-cb73-44f2-87b1-85d32269e32e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:17.140285 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2deb4999-cb73-44f2-87b1-85d32269e32e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:17.141068 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2deb4999-cb73-44f2-87b1-85d32269e32e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:17.141482 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2deb4999-cb73-44f2-87b1-85d32269e32e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:17.171491 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2deb4999-cb73-44f2-87b1-85d32269e32e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046604 Jul 04 06:02:17.172055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 538/1077] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:17.350901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-65ac2ed1-622c-440a-9769-abd596ef0ed9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:17.351582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-65ac2ed1-622c-440a-9769-abd596ef0ed9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:17.359272 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65ac2ed1-622c-440a-9769-abd596ef0ed9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:17.359784 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65ac2ed1-622c-440a-9769-abd596ef0ed9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:17.360632 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65ac2ed1-622c-440a-9769-abd596ef0ed9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:17.361118 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65ac2ed1-622c-440a-9769-abd596ef0ed9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:17.423507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-65ac2ed1-622c-440a-9769-abd596ef0ed9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:17.431230 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-65ac2ed1-622c-440a-9769-abd596ef0ed9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.086913 Jul 04 06:02:17.431835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 540/1078] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:17 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:18.186467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e5ff5e1a-136f-4dee-bc0d-3a68df2d7784 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:18.187663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e5ff5e1a-136f-4dee-bc0d-3a68df2d7784 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:18.197614 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5ff5e1a-136f-4dee-bc0d-3a68df2d7784 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:18.198192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5ff5e1a-136f-4dee-bc0d-3a68df2d7784 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:18.199188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5ff5e1a-136f-4dee-bc0d-3a68df2d7784 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:18.199860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5ff5e1a-136f-4dee-bc0d-3a68df2d7784 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:18.231642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e5ff5e1a-136f-4dee-bc0d-3a68df2d7784 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051472 Jul 04 06:02:18.232188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 539/1079] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:18.452876 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ed5a323-d0da-4175-b0fb-e69cdf64ba0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:18.453722 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ed5a323-d0da-4175-b0fb-e69cdf64ba0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:18.462601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ed5a323-d0da-4175-b0fb-e69cdf64ba0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:18.463051 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ed5a323-d0da-4175-b0fb-e69cdf64ba0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:18.463853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ed5a323-d0da-4175-b0fb-e69cdf64ba0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:18.464293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ed5a323-d0da-4175-b0fb-e69cdf64ba0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:18.527760 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ed5a323-d0da-4175-b0fb-e69cdf64ba0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:18.535881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ed5a323-d0da-4175-b0fb-e69cdf64ba0c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.089892 Jul 04 06:02:18.536493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 541/1080] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:18 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:19.247734 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7e508f89-8f44-4776-a765-d26b5c3fef06 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:19.249272 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7e508f89-8f44-4776-a765-d26b5c3fef06 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:19.259121 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e508f89-8f44-4776-a765-d26b5c3fef06 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:19.259610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e508f89-8f44-4776-a765-d26b5c3fef06 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:19.260359 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e508f89-8f44-4776-a765-d26b5c3fef06 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:19.260786 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e508f89-8f44-4776-a765-d26b5c3fef06 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:19.290583 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7e508f89-8f44-4776-a765-d26b5c3fef06 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049635 Jul 04 06:02:19.291153 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 540/1081] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:19.556515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-82e6ca3e-bdd4-41a3-9156-e61d71710a30 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:19.557113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-82e6ca3e-bdd4-41a3-9156-e61d71710a30 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:19.566994 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82e6ca3e-bdd4-41a3-9156-e61d71710a30 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:19.567515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82e6ca3e-bdd4-41a3-9156-e61d71710a30 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:19.568502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82e6ca3e-bdd4-41a3-9156-e61d71710a30 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:19.569226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82e6ca3e-bdd4-41a3-9156-e61d71710a30 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:19.632875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-82e6ca3e-bdd4-41a3-9156-e61d71710a30 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:19.640582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-82e6ca3e-bdd4-41a3-9156-e61d71710a30 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090337 Jul 04 06:02:19.641144 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 542/1082] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:19 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:20.306825 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c00b6f67-6df9-410e-a4e3-1a501299e4b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:20.308236 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c00b6f67-6df9-410e-a4e3-1a501299e4b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:20.319383 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c00b6f67-6df9-410e-a4e3-1a501299e4b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:20.319837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c00b6f67-6df9-410e-a4e3-1a501299e4b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:20.320618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c00b6f67-6df9-410e-a4e3-1a501299e4b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:20.321050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c00b6f67-6df9-410e-a4e3-1a501299e4b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:20.350595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c00b6f67-6df9-410e-a4e3-1a501299e4b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050547 Jul 04 06:02:20.351150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 541/1083] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:20 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:20.659222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a1333e00-f772-463e-8554-389a7633ed18 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:20.659871 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1333e00-f772-463e-8554-389a7633ed18 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:20.662358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:20.668015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1333e00-f772-463e-8554-389a7633ed18 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:20.668469 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1333e00-f772-463e-8554-389a7633ed18 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:20.669248 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1333e00-f772-463e-8554-389a7633ed18 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:20.669687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1333e00-f772-463e-8554-389a7633ed18 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:20.742916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1333e00-f772-463e-8554-389a7633ed18 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:20.754604 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a1333e00-f772-463e-8554-389a7633ed18 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.099394 Jul 04 06:02:20.755463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 543/1084] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:20 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:21.366372 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-810a1a82-99d7-4245-973e-815c433a1bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:21.367438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-810a1a82-99d7-4245-973e-815c433a1bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:21.375804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-810a1a82-99d7-4245-973e-815c433a1bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:21.376357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-810a1a82-99d7-4245-973e-815c433a1bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:21.377450 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-810a1a82-99d7-4245-973e-815c433a1bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:21.377996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-810a1a82-99d7-4245-973e-815c433a1bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:21.411972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-810a1a82-99d7-4245-973e-815c433a1bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052688 Jul 04 06:02:21.412517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 542/1085] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:21.772041 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4ea6548c-6360-4c3b-a7bc-9b937ee7e648 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:21.772854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4ea6548c-6360-4c3b-a7bc-9b937ee7e648 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:21.779689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ea6548c-6360-4c3b-a7bc-9b937ee7e648 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:21.779993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ea6548c-6360-4c3b-a7bc-9b937ee7e648 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:21.780765 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ea6548c-6360-4c3b-a7bc-9b937ee7e648 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:21.781203 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ea6548c-6360-4c3b-a7bc-9b937ee7e648 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:21.841813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4ea6548c-6360-4c3b-a7bc-9b937ee7e648 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:21.849651 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4ea6548c-6360-4c3b-a7bc-9b937ee7e648 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.081586 Jul 04 06:02:21.850281 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 544/1086] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:21 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:22.428163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c89c2172-a7dd-4e74-a589-5404b7d9cef3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:22.429660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c89c2172-a7dd-4e74-a589-5404b7d9cef3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:22.440570 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c89c2172-a7dd-4e74-a589-5404b7d9cef3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:22.441322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c89c2172-a7dd-4e74-a589-5404b7d9cef3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:22.442583 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c89c2172-a7dd-4e74-a589-5404b7d9cef3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:22.443403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c89c2172-a7dd-4e74-a589-5404b7d9cef3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:22.474998 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c89c2172-a7dd-4e74-a589-5404b7d9cef3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053697 Jul 04 06:02:22.475586 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 543/1087] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:22.866114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8b59d318-38eb-40a3-91eb-490c75e458ac tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:22.866730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8b59d318-38eb-40a3-91eb-490c75e458ac tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:22.873489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b59d318-38eb-40a3-91eb-490c75e458ac tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:22.873936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b59d318-38eb-40a3-91eb-490c75e458ac tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:22.874695 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b59d318-38eb-40a3-91eb-490c75e458ac tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:22.875129 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b59d318-38eb-40a3-91eb-490c75e458ac tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:22.945564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8b59d318-38eb-40a3-91eb-490c75e458ac tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:22.953545 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8b59d318-38eb-40a3-91eb-490c75e458ac tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091462 Jul 04 06:02:22.954108 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 545/1088] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:22 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:23.490459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8aa06ceb-5f83-4036-937e-65ac834eb82c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:23.491988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8aa06ceb-5f83-4036-937e-65ac834eb82c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:23.499727 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aa06ceb-5f83-4036-937e-65ac834eb82c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:23.500265 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aa06ceb-5f83-4036-937e-65ac834eb82c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:23.501114 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aa06ceb-5f83-4036-937e-65ac834eb82c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:23.501601 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8aa06ceb-5f83-4036-937e-65ac834eb82c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:23.535884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8aa06ceb-5f83-4036-937e-65ac834eb82c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052005 Jul 04 06:02:23.536463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 544/1089] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:23.978737 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-562bc936-b690-437f-a151-95af33899577 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:23.979820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-562bc936-b690-437f-a151-95af33899577 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:23.990707 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-562bc936-b690-437f-a151-95af33899577 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:23.991546 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-562bc936-b690-437f-a151-95af33899577 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:23.992769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-562bc936-b690-437f-a151-95af33899577 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:23.993544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-562bc936-b690-437f-a151-95af33899577 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:24.060205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-562bc936-b690-437f-a151-95af33899577 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:24.070575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-562bc936-b690-437f-a151-95af33899577 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.098190 Jul 04 06:02:24.071364 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 546/1090] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:23 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:24.548369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dd9db6c0-c1ab-431a-9657-b7104c55bed9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:24.549304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dd9db6c0-c1ab-431a-9657-b7104c55bed9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:24.556501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd9db6c0-c1ab-431a-9657-b7104c55bed9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:24.556955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd9db6c0-c1ab-431a-9657-b7104c55bed9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:24.557712 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd9db6c0-c1ab-431a-9657-b7104c55bed9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:24.558152 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd9db6c0-c1ab-431a-9657-b7104c55bed9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:24.587681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dd9db6c0-c1ab-431a-9657-b7104c55bed9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043333 Jul 04 06:02:24.588228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 545/1091] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:25.090162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4ac7189b-713c-468d-831e-e0ef8a05432b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:25.090779 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4ac7189b-713c-468d-831e-e0ef8a05432b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:25.097844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ac7189b-713c-468d-831e-e0ef8a05432b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:25.098301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ac7189b-713c-468d-831e-e0ef8a05432b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:25.099078 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ac7189b-713c-468d-831e-e0ef8a05432b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:25.099552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ac7189b-713c-468d-831e-e0ef8a05432b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:25.166925 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4ac7189b-713c-468d-831e-e0ef8a05432b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:25.174680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4ac7189b-713c-468d-831e-e0ef8a05432b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.089188 Jul 04 06:02:25.175240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 547/1092] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:25 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:25.603963 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe717100-9e68-41a6-81b5-acf445c2fe91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:25.605463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe717100-9e68-41a6-81b5-acf445c2fe91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:25.616510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe717100-9e68-41a6-81b5-acf445c2fe91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:25.617264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe717100-9e68-41a6-81b5-acf445c2fe91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:25.618413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe717100-9e68-41a6-81b5-acf445c2fe91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:25.618851 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe717100-9e68-41a6-81b5-acf445c2fe91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:25.635504 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:25.649258 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe717100-9e68-41a6-81b5-acf445c2fe91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052260 Jul 04 06:02:25.649823 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 546/1093] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:26.192591 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a352e33a-46df-44c4-ad17-22a02c0f963a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:26.193170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a352e33a-46df-44c4-ad17-22a02c0f963a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:26.200724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a352e33a-46df-44c4-ad17-22a02c0f963a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:26.201177 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a352e33a-46df-44c4-ad17-22a02c0f963a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:26.201938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a352e33a-46df-44c4-ad17-22a02c0f963a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:26.202371 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a352e33a-46df-44c4-ad17-22a02c0f963a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:26.273155 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a352e33a-46df-44c4-ad17-22a02c0f963a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:26.281020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a352e33a-46df-44c4-ad17-22a02c0f963a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092839 Jul 04 06:02:26.281603 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 548/1094] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:26 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:26.665705 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fd04f639-1c6c-4246-9045-0773ec3cd847 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:26.667291 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fd04f639-1c6c-4246-9045-0773ec3cd847 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:26.678404 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd04f639-1c6c-4246-9045-0773ec3cd847 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:26.679169 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd04f639-1c6c-4246-9045-0773ec3cd847 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:26.680640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd04f639-1c6c-4246-9045-0773ec3cd847 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:26.681060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd04f639-1c6c-4246-9045-0773ec3cd847 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:26.710969 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fd04f639-1c6c-4246-9045-0773ec3cd847 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052041 Jul 04 06:02:26.711550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 547/1095] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:27.302132 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-679da19e-d1f8-4128-a73d-21528a54f007 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:27.303109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-679da19e-d1f8-4128-a73d-21528a54f007 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:27.311077 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-679da19e-d1f8-4128-a73d-21528a54f007 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:27.311522 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-679da19e-d1f8-4128-a73d-21528a54f007 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:27.312287 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-679da19e-d1f8-4128-a73d-21528a54f007 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:27.312724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-679da19e-d1f8-4128-a73d-21528a54f007 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:27.377881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-679da19e-d1f8-4128-a73d-21528a54f007 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:27.385742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-679da19e-d1f8-4128-a73d-21528a54f007 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090240 Jul 04 06:02:27.386279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 549/1096] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:27 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:27.727060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-13e02d9b-0272-46ca-885f-3ddad10dca5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:27.728187 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-13e02d9b-0272-46ca-885f-3ddad10dca5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:27.730498 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=58 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:27.736445 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13e02d9b-0272-46ca-885f-3ddad10dca5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:27.736898 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13e02d9b-0272-46ca-885f-3ddad10dca5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:27.737663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13e02d9b-0272-46ca-885f-3ddad10dca5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:27.738102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13e02d9b-0272-46ca-885f-3ddad10dca5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:27.767761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-13e02d9b-0272-46ca-885f-3ddad10dca5e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047442 Jul 04 06:02:27.768330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 548/1097] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:28.406462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fc028418-cd4c-4f88-a84c-97c11a8fd6a8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:28.407760 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fc028418-cd4c-4f88-a84c-97c11a8fd6a8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:28.417401 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc028418-cd4c-4f88-a84c-97c11a8fd6a8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:28.417850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc028418-cd4c-4f88-a84c-97c11a8fd6a8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:28.418593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc028418-cd4c-4f88-a84c-97c11a8fd6a8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:28.419024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc028418-cd4c-4f88-a84c-97c11a8fd6a8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:28.479870 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fc028418-cd4c-4f88-a84c-97c11a8fd6a8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:28.487812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fc028418-cd4c-4f88-a84c-97c11a8fd6a8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.088275 Jul 04 06:02:28.488398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 550/1098] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:28 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:28.783762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0068819b-b97a-402a-a35b-1236f4d20a91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:28.785458 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0068819b-b97a-402a-a35b-1236f4d20a91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:28.796392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0068819b-b97a-402a-a35b-1236f4d20a91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:28.797140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0068819b-b97a-402a-a35b-1236f4d20a91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:28.798398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0068819b-b97a-402a-a35b-1236f4d20a91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:28.799103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0068819b-b97a-402a-a35b-1236f4d20a91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:28.835331 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0068819b-b97a-402a-a35b-1236f4d20a91 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058583 Jul 04 06:02:28.836107 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 549/1099] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:29.504848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ddeed08-2a87-4406-a51a-fbfa301698fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:29.505437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ddeed08-2a87-4406-a51a-fbfa301698fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:29.512632 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ddeed08-2a87-4406-a51a-fbfa301698fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:29.513286 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ddeed08-2a87-4406-a51a-fbfa301698fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:29.514603 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ddeed08-2a87-4406-a51a-fbfa301698fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:29.515200 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ddeed08-2a87-4406-a51a-fbfa301698fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:29.584380 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ddeed08-2a87-4406-a51a-fbfa301698fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:29.593219 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ddeed08-2a87-4406-a51a-fbfa301698fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092475 Jul 04 06:02:29.593794 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 551/1100] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:29 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:29.852964 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3accf63e-b358-4efb-ba07-2f1a14d98301 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:29.853786 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3accf63e-b358-4efb-ba07-2f1a14d98301 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:29.860752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3accf63e-b358-4efb-ba07-2f1a14d98301 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:29.861211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3accf63e-b358-4efb-ba07-2f1a14d98301 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:29.861982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3accf63e-b358-4efb-ba07-2f1a14d98301 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:29.862417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3accf63e-b358-4efb-ba07-2f1a14d98301 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:29.891456 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3accf63e-b358-4efb-ba07-2f1a14d98301 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047860 Jul 04 06:02:29.891993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 550/1101] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:30.610848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb575fad-c6fa-4fef-a249-51e11c634e51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:30.611554 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bb575fad-c6fa-4fef-a249-51e11c634e51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:30.618573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb575fad-c6fa-4fef-a249-51e11c634e51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:30.619016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb575fad-c6fa-4fef-a249-51e11c634e51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:30.619795 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb575fad-c6fa-4fef-a249-51e11c634e51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:30.620253 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb575fad-c6fa-4fef-a249-51e11c634e51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:30.682179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bb575fad-c6fa-4fef-a249-51e11c634e51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:30.689789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bb575fad-c6fa-4fef-a249-51e11c634e51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.082823 Jul 04 06:02:30.690348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 552/1102] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:30 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:30.908003 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7264eee4-1b35-404e-8af6-65bf295c0d6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:30.909948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7264eee4-1b35-404e-8af6-65bf295c0d6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:30.921603 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7264eee4-1b35-404e-8af6-65bf295c0d6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:30.923594 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7264eee4-1b35-404e-8af6-65bf295c0d6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:30.924975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7264eee4-1b35-404e-8af6-65bf295c0d6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:30.925747 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7264eee4-1b35-404e-8af6-65bf295c0d6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:30.957042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7264eee4-1b35-404e-8af6-65bf295c0d6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056354 Jul 04 06:02:30.957602 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 551/1103] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:30 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:31.707273 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-35b65ccf-de6b-4502-8499-043912b9e6c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:31.707911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-35b65ccf-de6b-4502-8499-043912b9e6c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:31.714951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35b65ccf-de6b-4502-8499-043912b9e6c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:31.715438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35b65ccf-de6b-4502-8499-043912b9e6c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:31.716209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35b65ccf-de6b-4502-8499-043912b9e6c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:31.716649 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35b65ccf-de6b-4502-8499-043912b9e6c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:31.783574 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-35b65ccf-de6b-4502-8499-043912b9e6c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:31.795890 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-35b65ccf-de6b-4502-8499-043912b9e6c0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091691 Jul 04 06:02:31.796686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 553/1104] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:31 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:31.799436 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:02:31.799682 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:02:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:02:31.973335 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4579ac61-54c7-486b-bb21-86c93fc11861 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:31.974810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4579ac61-54c7-486b-bb21-86c93fc11861 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:31.982861 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4579ac61-54c7-486b-bb21-86c93fc11861 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:31.983344 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4579ac61-54c7-486b-bb21-86c93fc11861 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:31.984116 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4579ac61-54c7-486b-bb21-86c93fc11861 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:31.984554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4579ac61-54c7-486b-bb21-86c93fc11861 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:32.013654 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4579ac61-54c7-486b-bb21-86c93fc11861 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046972 Jul 04 06:02:32.014170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 552/1105] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:31 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:32.817529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5a3a20f7-6c4c-4e33-82ed-abaeab8372ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:32.818541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5a3a20f7-6c4c-4e33-82ed-abaeab8372ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:32.827006 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a3a20f7-6c4c-4e33-82ed-abaeab8372ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:32.827496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a3a20f7-6c4c-4e33-82ed-abaeab8372ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:32.828268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a3a20f7-6c4c-4e33-82ed-abaeab8372ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:32.828706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a3a20f7-6c4c-4e33-82ed-abaeab8372ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:32.890392 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5a3a20f7-6c4c-4e33-82ed-abaeab8372ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:32.898164 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5a3a20f7-6c4c-4e33-82ed-abaeab8372ae tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.087321 Jul 04 06:02:32.898697 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 554/1106] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:32 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:33.029359 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-be6a4f4a-b3d9-482e-afc8-5efeaaf8f1ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:33.030489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-be6a4f4a-b3d9-482e-afc8-5efeaaf8f1ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:33.038946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be6a4f4a-b3d9-482e-afc8-5efeaaf8f1ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:33.039380 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be6a4f4a-b3d9-482e-afc8-5efeaaf8f1ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:33.040209 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be6a4f4a-b3d9-482e-afc8-5efeaaf8f1ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:33.040673 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be6a4f4a-b3d9-482e-afc8-5efeaaf8f1ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:33.069201 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-be6a4f4a-b3d9-482e-afc8-5efeaaf8f1ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046062 Jul 04 06:02:33.069771 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 553/1107] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:33.919705 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5c9df78-e49d-42a1-8264-71b5384f127e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:33.920715 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5c9df78-e49d-42a1-8264-71b5384f127e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:33.931600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5c9df78-e49d-42a1-8264-71b5384f127e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:33.932048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5c9df78-e49d-42a1-8264-71b5384f127e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:33.932822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5c9df78-e49d-42a1-8264-71b5384f127e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:33.933254 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5c9df78-e49d-42a1-8264-71b5384f127e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:33.951450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:33.997946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d5c9df78-e49d-42a1-8264-71b5384f127e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:34.006572 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5c9df78-e49d-42a1-8264-71b5384f127e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.093524 Jul 04 06:02:34.007152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 555/1108] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:33 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:34.081327 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e43276f-d87e-48f8-a983-08d4399943f2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:34.082266 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9e43276f-d87e-48f8-a983-08d4399943f2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:34.089774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e43276f-d87e-48f8-a983-08d4399943f2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:34.090227 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e43276f-d87e-48f8-a983-08d4399943f2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:34.091002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e43276f-d87e-48f8-a983-08d4399943f2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:34.091480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e43276f-d87e-48f8-a983-08d4399943f2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:34.122411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e43276f-d87e-48f8-a983-08d4399943f2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Jul 04 06:02:34.122965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 554/1109] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:34.192431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:02:34.192596 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:02:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:02:35.027461 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4d450eaa-89b9-41d9-bf76-42a4a3045dc2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:35.028485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4d450eaa-89b9-41d9-bf76-42a4a3045dc2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:35.039659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d450eaa-89b9-41d9-bf76-42a4a3045dc2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:35.040375 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d450eaa-89b9-41d9-bf76-42a4a3045dc2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:35.041170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d450eaa-89b9-41d9-bf76-42a4a3045dc2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:35.041606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d450eaa-89b9-41d9-bf76-42a4a3045dc2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:35.103640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4d450eaa-89b9-41d9-bf76-42a4a3045dc2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:35.111509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4d450eaa-89b9-41d9-bf76-42a4a3045dc2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090545 Jul 04 06:02:35.112114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 556/1110] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:35 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:35.134799 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-272db576-0d1e-4045-9218-63c4a9186782 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:35.135748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-272db576-0d1e-4045-9218-63c4a9186782 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:35.142793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-272db576-0d1e-4045-9218-63c4a9186782 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:35.143293 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-272db576-0d1e-4045-9218-63c4a9186782 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:35.144040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-272db576-0d1e-4045-9218-63c4a9186782 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:35.144479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-272db576-0d1e-4045-9218-63c4a9186782 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:35.173931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-272db576-0d1e-4045-9218-63c4a9186782 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043177 Jul 04 06:02:35.174477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 555/1111] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:36.133082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0c7d2809-7b18-4a08-9c23-bb76a40190ee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:36.133982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0c7d2809-7b18-4a08-9c23-bb76a40190ee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:36.144834 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c7d2809-7b18-4a08-9c23-bb76a40190ee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:36.145588 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c7d2809-7b18-4a08-9c23-bb76a40190ee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:36.146837 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c7d2809-7b18-4a08-9c23-bb76a40190ee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:36.147605 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c7d2809-7b18-4a08-9c23-bb76a40190ee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:36.185663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eed02778-9acd-4334-b3a9-9df981bfd471 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:36.186579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eed02778-9acd-4334-b3a9-9df981bfd471 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:36.193459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eed02778-9acd-4334-b3a9-9df981bfd471 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:36.193906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eed02778-9acd-4334-b3a9-9df981bfd471 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:36.194666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eed02778-9acd-4334-b3a9-9df981bfd471 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:36.195096 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eed02778-9acd-4334-b3a9-9df981bfd471 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:36.213074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0c7d2809-7b18-4a08-9c23-bb76a40190ee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:36.220604 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0c7d2809-7b18-4a08-9c23-bb76a40190ee tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.094384 Jul 04 06:02:36.221173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 557/1112] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:36 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:36.225955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eed02778-9acd-4334-b3a9-9df981bfd471 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044101 Jul 04 06:02:36.226517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 556/1113] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:02:37.241526 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d9f7c23-1a46-4772-9045-62d80996aaed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:37.242582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-05fb7dc9-5af0-4060-a999-63cb3378f011 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:37.243146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d9f7c23-1a46-4772-9045-62d80996aaed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:37.243592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-05fb7dc9-5af0-4060-a999-63cb3378f011 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:37.253559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d9f7c23-1a46-4772-9045-62d80996aaed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:37.254304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d9f7c23-1a46-4772-9045-62d80996aaed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:37.254964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05fb7dc9-5af0-4060-a999-63cb3378f011 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:37.255616 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d9f7c23-1a46-4772-9045-62d80996aaed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:37.256136 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05fb7dc9-5af0-4060-a999-63cb3378f011 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:37.256430 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d9f7c23-1a46-4772-9045-62d80996aaed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:37.257456 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05fb7dc9-5af0-4060-a999-63cb3378f011 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:37.258359 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05fb7dc9-5af0-4060-a999-63cb3378f011 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:37.289521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-05fb7dc9-5af0-4060-a999-63cb3378f011 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054477 Jul 04 06:02:37.290267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 558/1114] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:37.320790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1d9f7c23-1a46-4772-9045-62d80996aaed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:37.328750 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1d9f7c23-1a46-4772-9045-62d80996aaed tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.093786 Jul 04 06:02:37.329317 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 557/1115] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:37 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:38.305536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-60250bb8-04d7-405c-8157-475335ca1229 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:38.306967 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-60250bb8-04d7-405c-8157-475335ca1229 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:38.313936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60250bb8-04d7-405c-8157-475335ca1229 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:38.314384 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60250bb8-04d7-405c-8157-475335ca1229 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:38.315178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60250bb8-04d7-405c-8157-475335ca1229 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:38.315633 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60250bb8-04d7-405c-8157-475335ca1229 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:38.344930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-60250bb8-04d7-405c-8157-475335ca1229 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Jul 04 06:02:38.345478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 559/1116] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:38.345941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45bbaa38-4268-4f9d-a3e9-95065892e736 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:38.346517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-45bbaa38-4268-4f9d-a3e9-95065892e736 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:38.356057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45bbaa38-4268-4f9d-a3e9-95065892e736 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:38.356664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45bbaa38-4268-4f9d-a3e9-95065892e736 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:38.357811 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45bbaa38-4268-4f9d-a3e9-95065892e736 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:38.358402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45bbaa38-4268-4f9d-a3e9-95065892e736 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:38.425622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45bbaa38-4268-4f9d-a3e9-95065892e736 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:38.433451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45bbaa38-4268-4f9d-a3e9-95065892e736 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091611 Jul 04 06:02:38.434001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 558/1117] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:38 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:39.361102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d637b402-0ea3-4d5c-81be-9fe6d1907928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:39.362571 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d637b402-0ea3-4d5c-81be-9fe6d1907928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:39.372060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d637b402-0ea3-4d5c-81be-9fe6d1907928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:39.372504 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d637b402-0ea3-4d5c-81be-9fe6d1907928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:39.373276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d637b402-0ea3-4d5c-81be-9fe6d1907928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:39.373714 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d637b402-0ea3-4d5c-81be-9fe6d1907928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:39.403309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d637b402-0ea3-4d5c-81be-9fe6d1907928 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049171 Jul 04 06:02:39.403892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 560/1118] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:39.450252 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-290f4892-c9b0-48ca-b8d0-d5550593cc2d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:39.450860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-290f4892-c9b0-48ca-b8d0-d5550593cc2d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:39.458257 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-290f4892-c9b0-48ca-b8d0-d5550593cc2d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:39.458711 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-290f4892-c9b0-48ca-b8d0-d5550593cc2d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:39.459521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-290f4892-c9b0-48ca-b8d0-d5550593cc2d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:39.459955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-290f4892-c9b0-48ca-b8d0-d5550593cc2d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:39.525281 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-290f4892-c9b0-48ca-b8d0-d5550593cc2d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:39.533321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-290f4892-c9b0-48ca-b8d0-d5550593cc2d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.087181 Jul 04 06:02:39.533874 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 559/1119] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:39 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:40.418737 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bdaac65c-8f0c-4b6d-b0b7-bb88b9ffa89d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:40.419884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bdaac65c-8f0c-4b6d-b0b7-bb88b9ffa89d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:40.428809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bdaac65c-8f0c-4b6d-b0b7-bb88b9ffa89d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:40.429405 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bdaac65c-8f0c-4b6d-b0b7-bb88b9ffa89d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:40.430424 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bdaac65c-8f0c-4b6d-b0b7-bb88b9ffa89d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:40.431003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bdaac65c-8f0c-4b6d-b0b7-bb88b9ffa89d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:40.464538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bdaac65c-8f0c-4b6d-b0b7-bb88b9ffa89d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052109 Jul 04 06:02:40.465084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 561/1120] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:40.553698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2911b401-beb2-433c-9add-bb138e869f02 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:40.554944 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2911b401-beb2-433c-9add-bb138e869f02 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:40.562191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2911b401-beb2-433c-9add-bb138e869f02 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:40.562644 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2911b401-beb2-433c-9add-bb138e869f02 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:40.563450 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2911b401-beb2-433c-9add-bb138e869f02 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:40.563888 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2911b401-beb2-433c-9add-bb138e869f02 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:40.626361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2911b401-beb2-433c-9add-bb138e869f02 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:40.638107 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2911b401-beb2-433c-9add-bb138e869f02 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090445 Jul 04 06:02:40.638935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 560/1121] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:40 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:41.480045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d8b97b57-eff9-4ad4-8c89-c138149deaae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:41.481550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d8b97b57-eff9-4ad4-8c89-c138149deaae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:41.492549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8b97b57-eff9-4ad4-8c89-c138149deaae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:41.493302 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8b97b57-eff9-4ad4-8c89-c138149deaae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:41.494606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8b97b57-eff9-4ad4-8c89-c138149deaae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:41.495042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8b97b57-eff9-4ad4-8c89-c138149deaae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:41.526137 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d8b97b57-eff9-4ad4-8c89-c138149deaae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052916 Jul 04 06:02:41.526713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 562/1122] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:41 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:41.659052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2dba8b7e-9d04-4a17-961b-aa6484a07f3b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:41.660081 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2dba8b7e-9d04-4a17-961b-aa6484a07f3b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:41.669323 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dba8b7e-9d04-4a17-961b-aa6484a07f3b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:41.669768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dba8b7e-9d04-4a17-961b-aa6484a07f3b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:41.670528 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dba8b7e-9d04-4a17-961b-aa6484a07f3b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:41.670956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dba8b7e-9d04-4a17-961b-aa6484a07f3b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:41.741373 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2dba8b7e-9d04-4a17-961b-aa6484a07f3b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:41.749298 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2dba8b7e-9d04-4a17-961b-aa6484a07f3b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.096856 Jul 04 06:02:41.749882 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 561/1123] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:41 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:42.540526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a25bf203-d773-4a83-bd4d-bfd1f2b7221b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:42.541637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a25bf203-d773-4a83-bd4d-bfd1f2b7221b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:42.548583 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a25bf203-d773-4a83-bd4d-bfd1f2b7221b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:42.549029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a25bf203-d773-4a83-bd4d-bfd1f2b7221b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:42.549787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a25bf203-d773-4a83-bd4d-bfd1f2b7221b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:42.550194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a25bf203-d773-4a83-bd4d-bfd1f2b7221b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:42.580139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a25bf203-d773-4a83-bd4d-bfd1f2b7221b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Jul 04 06:02:42.580688 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 563/1124] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:42 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:42.770289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c1c8cf34-f0c0-40cc-830a-94c7e3d96ab9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:42.771118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c1c8cf34-f0c0-40cc-830a-94c7e3d96ab9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:42.779856 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1c8cf34-f0c0-40cc-830a-94c7e3d96ab9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:42.780310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1c8cf34-f0c0-40cc-830a-94c7e3d96ab9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:42.781084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1c8cf34-f0c0-40cc-830a-94c7e3d96ab9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:42.781868 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1c8cf34-f0c0-40cc-830a-94c7e3d96ab9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:42.847296 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c1c8cf34-f0c0-40cc-830a-94c7e3d96ab9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:42.855122 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c1c8cf34-f0c0-40cc-830a-94c7e3d96ab9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091660 Jul 04 06:02:42.855723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 562/1125] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:42 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:43.596087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9c7d3355-7103-4d69-bf8e-686ecb159151 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:43.597581 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9c7d3355-7103-4d69-bf8e-686ecb159151 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:43.608946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c7d3355-7103-4d69-bf8e-686ecb159151 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:43.609691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c7d3355-7103-4d69-bf8e-686ecb159151 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:43.611015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c7d3355-7103-4d69-bf8e-686ecb159151 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:43.611947 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c7d3355-7103-4d69-bf8e-686ecb159151 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:43.644500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9c7d3355-7103-4d69-bf8e-686ecb159151 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055047 Jul 04 06:02:43.645060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 564/1126] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:43.874263 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-521483ca-3640-4514-8553-8fbddb373e0a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:43.874831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-521483ca-3640-4514-8553-8fbddb373e0a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:43.882178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-521483ca-3640-4514-8553-8fbddb373e0a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:43.882636 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-521483ca-3640-4514-8553-8fbddb373e0a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:43.883481 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-521483ca-3640-4514-8553-8fbddb373e0a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:43.883938 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-521483ca-3640-4514-8553-8fbddb373e0a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:43.888895 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:43.946380 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-521483ca-3640-4514-8553-8fbddb373e0a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:43.954203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-521483ca-3640-4514-8553-8fbddb373e0a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.084135 Jul 04 06:02:43.954763 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 563/1127] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:43 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:44.662442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ecc3d99b-fe00-452f-a86c-e02d443ecef1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:44.663980 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ecc3d99b-fe00-452f-a86c-e02d443ecef1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:44.671826 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecc3d99b-fe00-452f-a86c-e02d443ecef1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:44.672280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecc3d99b-fe00-452f-a86c-e02d443ecef1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:44.673042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecc3d99b-fe00-452f-a86c-e02d443ecef1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:44.673477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecc3d99b-fe00-452f-a86c-e02d443ecef1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:44.705173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ecc3d99b-fe00-452f-a86c-e02d443ecef1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049744 Jul 04 06:02:44.705722 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 565/1128] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:44 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:44.970875 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e2024662-6ea1-4fa9-aa91-86cd4ee309bd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:44.971496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e2024662-6ea1-4fa9-aa91-86cd4ee309bd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:44.979325 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2024662-6ea1-4fa9-aa91-86cd4ee309bd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:44.979995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2024662-6ea1-4fa9-aa91-86cd4ee309bd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:44.982491 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2024662-6ea1-4fa9-aa91-86cd4ee309bd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:44.982491 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2024662-6ea1-4fa9-aa91-86cd4ee309bd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:45.044377 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e2024662-6ea1-4fa9-aa91-86cd4ee309bd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:45.052015 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e2024662-6ea1-4fa9-aa91-86cd4ee309bd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.085109 Jul 04 06:02:45.052563 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 564/1129] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:44 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:45.727236 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f562c7f0-d902-4f13-ab1d-b75eeb63860c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:45.728847 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f562c7f0-d902-4f13-ab1d-b75eeb63860c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:45.736447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f562c7f0-d902-4f13-ab1d-b75eeb63860c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:45.736898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f562c7f0-d902-4f13-ab1d-b75eeb63860c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:45.737676 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f562c7f0-d902-4f13-ab1d-b75eeb63860c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:45.738114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f562c7f0-d902-4f13-ab1d-b75eeb63860c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:45.768355 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f562c7f0-d902-4f13-ab1d-b75eeb63860c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051099 Jul 04 06:02:45.768913 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 566/1130] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:46.068758 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d589adb5-3ce6-48ac-ab43-73cda1c224ca tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:46.069363 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d589adb5-3ce6-48ac-ab43-73cda1c224ca tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:46.076002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d589adb5-3ce6-48ac-ab43-73cda1c224ca tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:46.076443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d589adb5-3ce6-48ac-ab43-73cda1c224ca tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:46.077197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d589adb5-3ce6-48ac-ab43-73cda1c224ca tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:46.077628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d589adb5-3ce6-48ac-ab43-73cda1c224ca tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:46.137622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d589adb5-3ce6-48ac-ab43-73cda1c224ca tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:46.145402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d589adb5-3ce6-48ac-ab43-73cda1c224ca tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.080475 Jul 04 06:02:46.145988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 565/1131] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:46 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:46.786676 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4124125e-3b36-40d6-b412-781deed536b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:46.788227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4124125e-3b36-40d6-b412-781deed536b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:46.799329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4124125e-3b36-40d6-b412-781deed536b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:46.800126 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4124125e-3b36-40d6-b412-781deed536b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:46.801394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4124125e-3b36-40d6-b412-781deed536b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:46.802121 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4124125e-3b36-40d6-b412-781deed536b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:46.834809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4124125e-3b36-40d6-b412-781deed536b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055275 Jul 04 06:02:46.835404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 567/1132] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:46 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:47.162597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2c8a8b49-f181-4357-9f27-5535a7b65bf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:47.163891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2c8a8b49-f181-4357-9f27-5535a7b65bf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:47.170584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8a8b49-f181-4357-9f27-5535a7b65bf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:47.171037 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8a8b49-f181-4357-9f27-5535a7b65bf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:47.171867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8a8b49-f181-4357-9f27-5535a7b65bf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:47.172339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8a8b49-f181-4357-9f27-5535a7b65bf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:47.236704 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2c8a8b49-f181-4357-9f27-5535a7b65bf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:47.246318 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2c8a8b49-f181-4357-9f27-5535a7b65bf5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.087724 Jul 04 06:02:47.246880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 566/1133] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:47 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:47.847701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-629ec1cc-e954-43f3-b449-86bf1dd0a2a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:47.848541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-629ec1cc-e954-43f3-b449-86bf1dd0a2a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:47.855533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-629ec1cc-e954-43f3-b449-86bf1dd0a2a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:47.855982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-629ec1cc-e954-43f3-b449-86bf1dd0a2a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:47.856751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-629ec1cc-e954-43f3-b449-86bf1dd0a2a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:47.857185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-629ec1cc-e954-43f3-b449-86bf1dd0a2a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:47.887187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-629ec1cc-e954-43f3-b449-86bf1dd0a2a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043865 Jul 04 06:02:47.887780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 568/1134] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:48.265098 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2f2ca72a-5a57-4909-b92d-775776db5ca7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:48.265829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2f2ca72a-5a57-4909-b92d-775776db5ca7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:48.273331 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f2ca72a-5a57-4909-b92d-775776db5ca7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:48.273923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f2ca72a-5a57-4909-b92d-775776db5ca7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:48.275085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f2ca72a-5a57-4909-b92d-775776db5ca7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:48.275737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f2ca72a-5a57-4909-b92d-775776db5ca7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:48.345640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2f2ca72a-5a57-4909-b92d-775776db5ca7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:48.356455 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2f2ca72a-5a57-4909-b92d-775776db5ca7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.095566 Jul 04 06:02:48.356922 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 567/1135] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:48 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:48.902604 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8b96196c-9d3c-4b41-ace4-e796c889ab8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:48.903975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8b96196c-9d3c-4b41-ace4-e796c889ab8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:48.912551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b96196c-9d3c-4b41-ace4-e796c889ab8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:48.913071 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b96196c-9d3c-4b41-ace4-e796c889ab8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:48.913968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b96196c-9d3c-4b41-ace4-e796c889ab8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:48.914477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b96196c-9d3c-4b41-ace4-e796c889ab8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:48.950934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8b96196c-9d3c-4b41-ace4-e796c889ab8b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054917 Jul 04 06:02:48.951516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 569/1136] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:49.378512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dca9c264-6e27-4fd3-b3d1-dab6fdc02f64 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:49.379566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dca9c264-6e27-4fd3-b3d1-dab6fdc02f64 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:49.389645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dca9c264-6e27-4fd3-b3d1-dab6fdc02f64 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:49.390101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dca9c264-6e27-4fd3-b3d1-dab6fdc02f64 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:49.390871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dca9c264-6e27-4fd3-b3d1-dab6fdc02f64 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:49.391367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dca9c264-6e27-4fd3-b3d1-dab6fdc02f64 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:49.460140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dca9c264-6e27-4fd3-b3d1-dab6fdc02f64 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:49.470440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dca9c264-6e27-4fd3-b3d1-dab6fdc02f64 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.098531 Jul 04 06:02:49.470996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 568/1137] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:49 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:49.561036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:02:49.561373 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:02:49.966659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2b1d11ee-c56a-4393-939f-dc3453f4aa8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:49.968212 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2b1d11ee-c56a-4393-939f-dc3453f4aa8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:49.979157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b1d11ee-c56a-4393-939f-dc3453f4aa8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:49.979998 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b1d11ee-c56a-4393-939f-dc3453f4aa8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:49.981263 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b1d11ee-c56a-4393-939f-dc3453f4aa8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:49.981727 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2b1d11ee-c56a-4393-939f-dc3453f4aa8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:50.011667 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2b1d11ee-c56a-4393-939f-dc3453f4aa8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051758 Jul 04 06:02:50.012276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 570/1138] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:50.492413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cb386731-f510-44f9-b490-96ef88ee5189 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:50.493325 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cb386731-f510-44f9-b490-96ef88ee5189 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:50.501973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb386731-f510-44f9-b490-96ef88ee5189 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:50.502421 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb386731-f510-44f9-b490-96ef88ee5189 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:50.503218 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb386731-f510-44f9-b490-96ef88ee5189 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:50.503659 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb386731-f510-44f9-b490-96ef88ee5189 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:50.569683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cb386731-f510-44f9-b490-96ef88ee5189 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:50.577500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cb386731-f510-44f9-b490-96ef88ee5189 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091816 Jul 04 06:02:50.578050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 569/1139] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:50 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:51.027029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-96ad05cf-474f-43d5-8353-f87544c4e57b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:51.028535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-96ad05cf-474f-43d5-8353-f87544c4e57b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:51.030838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:51.036709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96ad05cf-474f-43d5-8353-f87544c4e57b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:51.037169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96ad05cf-474f-43d5-8353-f87544c4e57b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:51.037936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96ad05cf-474f-43d5-8353-f87544c4e57b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:51.038374 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96ad05cf-474f-43d5-8353-f87544c4e57b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:51.068548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-96ad05cf-474f-43d5-8353-f87544c4e57b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047701 Jul 04 06:02:51.069112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 571/1140] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:51 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:51.598288 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a27998c3-7b1f-4aa9-8019-9ee0be7f5ec5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:51.599113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a27998c3-7b1f-4aa9-8019-9ee0be7f5ec5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:51.608975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a27998c3-7b1f-4aa9-8019-9ee0be7f5ec5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:51.609431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a27998c3-7b1f-4aa9-8019-9ee0be7f5ec5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:51.610206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a27998c3-7b1f-4aa9-8019-9ee0be7f5ec5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:51.610648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a27998c3-7b1f-4aa9-8019-9ee0be7f5ec5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:51.685016 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a27998c3-7b1f-4aa9-8019-9ee0be7f5ec5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:51.692590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a27998c3-7b1f-4aa9-8019-9ee0be7f5ec5 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.101053 Jul 04 06:02:51.693143 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 570/1141] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:51 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:52.087027 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a469fe92-331c-49e6-8c5c-aa0dda2454f0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:52.088564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a469fe92-331c-49e6-8c5c-aa0dda2454f0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:52.099602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a469fe92-331c-49e6-8c5c-aa0dda2454f0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:52.100358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a469fe92-331c-49e6-8c5c-aa0dda2454f0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:52.101600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a469fe92-331c-49e6-8c5c-aa0dda2454f0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:52.102335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a469fe92-331c-49e6-8c5c-aa0dda2454f0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:52.107740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:52.133466 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a469fe92-331c-49e6-8c5c-aa0dda2454f0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056019 Jul 04 06:02:52.134026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 572/1142] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:52 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:52.713713 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-474ff5b9-02d5-44e7-b266-fc70e1b7126c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:52.714608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-474ff5b9-02d5-44e7-b266-fc70e1b7126c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:52.722316 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-474ff5b9-02d5-44e7-b266-fc70e1b7126c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:52.722790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-474ff5b9-02d5-44e7-b266-fc70e1b7126c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:52.723626 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-474ff5b9-02d5-44e7-b266-fc70e1b7126c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:52.724082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-474ff5b9-02d5-44e7-b266-fc70e1b7126c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:52.786161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-474ff5b9-02d5-44e7-b266-fc70e1b7126c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:52.794152 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-474ff5b9-02d5-44e7-b266-fc70e1b7126c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.086966 Jul 04 06:02:52.794734 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 571/1143] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:52 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:53.063699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:02:53.064110 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:02:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:02:53.149594 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-27191f90-9ecf-4878-afea-53c2d01b1e2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:53.151131 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-27191f90-9ecf-4878-afea-53c2d01b1e2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:53.162502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27191f90-9ecf-4878-afea-53c2d01b1e2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:53.163305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27191f90-9ecf-4878-afea-53c2d01b1e2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:53.164577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27191f90-9ecf-4878-afea-53c2d01b1e2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:53.165357 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27191f90-9ecf-4878-afea-53c2d01b1e2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:53.197210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-27191f90-9ecf-4878-afea-53c2d01b1e2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054370 Jul 04 06:02:53.197764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 573/1144] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:53 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:53.811729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-44a062d0-f567-4ccd-9a19-01a5ffa8618d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:53.812374 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-44a062d0-f567-4ccd-9a19-01a5ffa8618d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:53.819540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44a062d0-f567-4ccd-9a19-01a5ffa8618d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:53.819986 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44a062d0-f567-4ccd-9a19-01a5ffa8618d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:53.820753 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44a062d0-f567-4ccd-9a19-01a5ffa8618d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:53.821190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44a062d0-f567-4ccd-9a19-01a5ffa8618d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:53.883234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-44a062d0-f567-4ccd-9a19-01a5ffa8618d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:53.890998 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-44a062d0-f567-4ccd-9a19-01a5ffa8618d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.083400 Jul 04 06:02:53.891811 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 572/1145] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:53 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:54.213501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b7e47431-5544-49e5-b507-b0a47e90cad1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:54.214997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b7e47431-5544-49e5-b507-b0a47e90cad1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:54.222765 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7e47431-5544-49e5-b507-b0a47e90cad1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:54.223219 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7e47431-5544-49e5-b507-b0a47e90cad1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:54.224007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7e47431-5544-49e5-b507-b0a47e90cad1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:54.224441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7e47431-5544-49e5-b507-b0a47e90cad1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:54.253841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b7e47431-5544-49e5-b507-b0a47e90cad1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047066 Jul 04 06:02:54.254397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 574/1146] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:54.908722 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cbb3d11e-105a-4585-a6b9-a9f49dbf10a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:54.909390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cbb3d11e-105a-4585-a6b9-a9f49dbf10a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:54.916699 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbb3d11e-105a-4585-a6b9-a9f49dbf10a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:54.917141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbb3d11e-105a-4585-a6b9-a9f49dbf10a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:54.917898 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbb3d11e-105a-4585-a6b9-a9f49dbf10a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:54.918326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbb3d11e-105a-4585-a6b9-a9f49dbf10a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:54.979552 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cbb3d11e-105a-4585-a6b9-a9f49dbf10a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:54.987831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cbb3d11e-105a-4585-a6b9-a9f49dbf10a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.083588 Jul 04 06:02:54.988386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 573/1147] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:54 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:55.270587 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7b88b648-dbfb-4a27-9b5d-490aac505c66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:55.272255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7b88b648-dbfb-4a27-9b5d-490aac505c66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:55.283669 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b88b648-dbfb-4a27-9b5d-490aac505c66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:55.284400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b88b648-dbfb-4a27-9b5d-490aac505c66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:55.285694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b88b648-dbfb-4a27-9b5d-490aac505c66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:55.286403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b88b648-dbfb-4a27-9b5d-490aac505c66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:55.321069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7b88b648-dbfb-4a27-9b5d-490aac505c66 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057158 Jul 04 06:02:55.321625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 575/1148] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:56.005011 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-845a3b2b-bf8f-455d-ab82-9e450b48931d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:56.005574 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-845a3b2b-bf8f-455d-ab82-9e450b48931d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:56.012005 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-845a3b2b-bf8f-455d-ab82-9e450b48931d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:56.012447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-845a3b2b-bf8f-455d-ab82-9e450b48931d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:56.013213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-845a3b2b-bf8f-455d-ab82-9e450b48931d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:56.013689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-845a3b2b-bf8f-455d-ab82-9e450b48931d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:56.077013 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-845a3b2b-bf8f-455d-ab82-9e450b48931d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:56.084922 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-845a3b2b-bf8f-455d-ab82-9e450b48931d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.084169 Jul 04 06:02:56.085652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 574/1149] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:55 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:56.336548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b7a51f1b-6ebe-403a-a757-10770f32916e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:56.338022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b7a51f1b-6ebe-403a-a757-10770f32916e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:56.346570 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7a51f1b-6ebe-403a-a757-10770f32916e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:56.347011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7a51f1b-6ebe-403a-a757-10770f32916e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:56.347905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7a51f1b-6ebe-403a-a757-10770f32916e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:56.348330 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7a51f1b-6ebe-403a-a757-10770f32916e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:56.379094 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b7a51f1b-6ebe-403a-a757-10770f32916e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049291 Jul 04 06:02:56.379689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 576/1150] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:56 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:57.102369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f14fb214-8255-4e8e-bb21-85bcd1697bd6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:57.102950 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f14fb214-8255-4e8e-bb21-85bcd1697bd6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:57.109634 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f14fb214-8255-4e8e-bb21-85bcd1697bd6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:57.110085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f14fb214-8255-4e8e-bb21-85bcd1697bd6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:57.110824 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f14fb214-8255-4e8e-bb21-85bcd1697bd6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:57.111290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f14fb214-8255-4e8e-bb21-85bcd1697bd6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:57.178573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f14fb214-8255-4e8e-bb21-85bcd1697bd6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:57.188815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f14fb214-8255-4e8e-bb21-85bcd1697bd6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090489 Jul 04 06:02:57.189351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 575/1151] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:57 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:57.392444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6aba381a-517d-4132-9e74-fb39a1e8a8ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:57.393376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6aba381a-517d-4132-9e74-fb39a1e8a8ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:57.400316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aba381a-517d-4132-9e74-fb39a1e8a8ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:57.400764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aba381a-517d-4132-9e74-fb39a1e8a8ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:57.401535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aba381a-517d-4132-9e74-fb39a1e8a8ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:57.401972 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aba381a-517d-4132-9e74-fb39a1e8a8ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:57.433003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6aba381a-517d-4132-9e74-fb39a1e8a8ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045286 Jul 04 06:02:57.433555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 577/1152] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:57 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:58.208069 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a521d538-b754-48d6-b459-15317619ba51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:58.208864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a521d538-b754-48d6-b459-15317619ba51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:58.211863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=56 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:58.218925 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a521d538-b754-48d6-b459-15317619ba51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:58.219541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a521d538-b754-48d6-b459-15317619ba51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:58.220560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a521d538-b754-48d6-b459-15317619ba51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:58.221125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a521d538-b754-48d6-b459-15317619ba51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:58.286560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a521d538-b754-48d6-b459-15317619ba51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:58.294348 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a521d538-b754-48d6-b459-15317619ba51 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092251 Jul 04 06:02:58.294947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 576/1153] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:58 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:58.448581 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-43e119f2-f769-40cf-ad21-fedbe8ad5587 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:58.450062 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-43e119f2-f769-40cf-ad21-fedbe8ad5587 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:58.461308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43e119f2-f769-40cf-ad21-fedbe8ad5587 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:58.461944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43e119f2-f769-40cf-ad21-fedbe8ad5587 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:58.463182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43e119f2-f769-40cf-ad21-fedbe8ad5587 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:58.463970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43e119f2-f769-40cf-ad21-fedbe8ad5587 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:58.494123 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-43e119f2-f769-40cf-ad21-fedbe8ad5587 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052237 Jul 04 06:02:58.494668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 578/1154] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:02:59.314311 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-216b5be6-b5b7-476a-806a-7963770736c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:59.314881 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-216b5be6-b5b7-476a-806a-7963770736c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:59.322528 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-216b5be6-b5b7-476a-806a-7963770736c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:59.322528 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-216b5be6-b5b7-476a-806a-7963770736c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:59.323473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-216b5be6-b5b7-476a-806a-7963770736c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:59.324010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-216b5be6-b5b7-476a-806a-7963770736c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:59.385888 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-216b5be6-b5b7-476a-806a-7963770736c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:02:59.394136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-216b5be6-b5b7-476a-806a-7963770736c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.085727 Jul 04 06:02:59.394711 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 577/1155] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:02:59 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:02:59.510386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cf50d7cd-5008-4027-be9b-dc2835d02620 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:02:59.511996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cf50d7cd-5008-4027-be9b-dc2835d02620 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:02:59.520599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf50d7cd-5008-4027-be9b-dc2835d02620 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:59.521070 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf50d7cd-5008-4027-be9b-dc2835d02620 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:59.521843 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf50d7cd-5008-4027-be9b-dc2835d02620 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:02:59.522248 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf50d7cd-5008-4027-be9b-dc2835d02620 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:02:59.553266 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cf50d7cd-5008-4027-be9b-dc2835d02620 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049740 Jul 04 06:02:59.553825 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 579/1156] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:02:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:00.415653 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9ba5fa27-b982-4542-a906-a1a1b688b539 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:00.416509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9ba5fa27-b982-4542-a906-a1a1b688b539 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:00.427474 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ba5fa27-b982-4542-a906-a1a1b688b539 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:00.428234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ba5fa27-b982-4542-a906-a1a1b688b539 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:00.429487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ba5fa27-b982-4542-a906-a1a1b688b539 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:00.430211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ba5fa27-b982-4542-a906-a1a1b688b539 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:00.499429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9ba5fa27-b982-4542-a906-a1a1b688b539 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:00.507518 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9ba5fa27-b982-4542-a906-a1a1b688b539 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.098552 Jul 04 06:03:00.508080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 578/1157] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:00 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:00.564451 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d2091620-c70e-4b9d-9dee-e15a22334275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:00.565378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d2091620-c70e-4b9d-9dee-e15a22334275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:00.572348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2091620-c70e-4b9d-9dee-e15a22334275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:00.572792 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2091620-c70e-4b9d-9dee-e15a22334275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:00.573555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2091620-c70e-4b9d-9dee-e15a22334275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:00.573989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2091620-c70e-4b9d-9dee-e15a22334275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:00.603701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d2091620-c70e-4b9d-9dee-e15a22334275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043267 Jul 04 06:03:00.604257 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 580/1158] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:00 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:01.524482 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c7b4231b-3f7d-43f3-95c5-6219a03a88db tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:01.525080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c7b4231b-3f7d-43f3-95c5-6219a03a88db tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:01.532400 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7b4231b-3f7d-43f3-95c5-6219a03a88db tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:01.532844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7b4231b-3f7d-43f3-95c5-6219a03a88db tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:01.533611 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7b4231b-3f7d-43f3-95c5-6219a03a88db tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:01.534047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7b4231b-3f7d-43f3-95c5-6219a03a88db tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:01.596155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c7b4231b-3f7d-43f3-95c5-6219a03a88db tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:01.599762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:01.604254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c7b4231b-3f7d-43f3-95c5-6219a03a88db tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.083778 Jul 04 06:03:01.604818 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 579/1159] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:01 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:01.615473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cf5866fb-da00-4201-a318-d9c5d4067ebc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:01.616406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cf5866fb-da00-4201-a318-d9c5d4067ebc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:01.623334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf5866fb-da00-4201-a318-d9c5d4067ebc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:01.623790 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf5866fb-da00-4201-a318-d9c5d4067ebc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:01.624563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf5866fb-da00-4201-a318-d9c5d4067ebc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:01.624997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf5866fb-da00-4201-a318-d9c5d4067ebc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:01.654409 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cf5866fb-da00-4201-a318-d9c5d4067ebc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042958 Jul 04 06:03:01.654966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 581/1160] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:01 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:02.626061 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45a017c0-7116-410d-ae56-b205831a497b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:02.626677 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-45a017c0-7116-410d-ae56-b205831a497b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:02.634121 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45a017c0-7116-410d-ae56-b205831a497b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:02.634596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45a017c0-7116-410d-ae56-b205831a497b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:02.635454 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45a017c0-7116-410d-ae56-b205831a497b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:02.635917 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45a017c0-7116-410d-ae56-b205831a497b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:02.666250 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5d91f2a-fc5a-4723-a87f-e86c15b9fd5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:02.667342 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5d91f2a-fc5a-4723-a87f-e86c15b9fd5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:02.674093 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5d91f2a-fc5a-4723-a87f-e86c15b9fd5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:02.674556 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5d91f2a-fc5a-4723-a87f-e86c15b9fd5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:02.675353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5d91f2a-fc5a-4723-a87f-e86c15b9fd5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:02.675793 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5d91f2a-fc5a-4723-a87f-e86c15b9fd5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:02.698246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45a017c0-7116-410d-ae56-b205831a497b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:02.705961 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5d91f2a-fc5a-4723-a87f-e86c15b9fd5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043587 Jul 04 06:03:02.706449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45a017c0-7116-410d-ae56-b205831a497b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.087161 Jul 04 06:03:02.706616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 582/1161] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:02 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:02.707041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 580/1162] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:02 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:03.722341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e2dfa91e-17b0-4d73-9ce2-3470baff9f39 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:03.724065 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e2dfa91e-17b0-4d73-9ce2-3470baff9f39 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:03.735232 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2dfa91e-17b0-4d73-9ce2-3470baff9f39 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:03.735713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2dfa91e-17b0-4d73-9ce2-3470baff9f39 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:03.736484 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2dfa91e-17b0-4d73-9ce2-3470baff9f39 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:03.736911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2dfa91e-17b0-4d73-9ce2-3470baff9f39 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:03.767369 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e2dfa91e-17b0-4d73-9ce2-3470baff9f39 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051918 Jul 04 06:03:03.767928 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 583/1163] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:03.789502 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c1c2218c-b06f-44a5-9749-3e1b41f6141a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:03.790121 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c1c2218c-b06f-44a5-9749-3e1b41f6141a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:03.796322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1c2218c-b06f-44a5-9749-3e1b41f6141a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:03.796778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1c2218c-b06f-44a5-9749-3e1b41f6141a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:03.797604 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1c2218c-b06f-44a5-9749-3e1b41f6141a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:03.798050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1c2218c-b06f-44a5-9749-3e1b41f6141a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:03.869036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c1c2218c-b06f-44a5-9749-3e1b41f6141a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:03.878989 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c1c2218c-b06f-44a5-9749-3e1b41f6141a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.155334 Jul 04 06:03:03.879710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 581/1164] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:03 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:04.782960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b02443e1-3aae-4072-9530-c68fe141100b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:04.784132 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b02443e1-3aae-4072-9530-c68fe141100b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:04.792643 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b02443e1-3aae-4072-9530-c68fe141100b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:04.793208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b02443e1-3aae-4072-9530-c68fe141100b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:04.794157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b02443e1-3aae-4072-9530-c68fe141100b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:04.794701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b02443e1-3aae-4072-9530-c68fe141100b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:04.827417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b02443e1-3aae-4072-9530-c68fe141100b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051327 Jul 04 06:03:04.827966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 584/1165] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:04.904179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b50ac748-c47e-4fd6-b838-d1a4512e9ee7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:04.905142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b50ac748-c47e-4fd6-b838-d1a4512e9ee7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:04.912961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b50ac748-c47e-4fd6-b838-d1a4512e9ee7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:04.914449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b50ac748-c47e-4fd6-b838-d1a4512e9ee7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:04.914449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b50ac748-c47e-4fd6-b838-d1a4512e9ee7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:04.914706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b50ac748-c47e-4fd6-b838-d1a4512e9ee7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:04.978992 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b50ac748-c47e-4fd6-b838-d1a4512e9ee7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:04.986865 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b50ac748-c47e-4fd6-b838-d1a4512e9ee7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.089369 Jul 04 06:03:04.987445 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 582/1166] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:04 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:05.843471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-51a9a582-d903-4325-85f3-5da1b0ae2f5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:05.845056 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-51a9a582-d903-4325-85f3-5da1b0ae2f5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:05.852714 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51a9a582-d903-4325-85f3-5da1b0ae2f5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:05.853187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51a9a582-d903-4325-85f3-5da1b0ae2f5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:05.853992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51a9a582-d903-4325-85f3-5da1b0ae2f5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:05.854446 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51a9a582-d903-4325-85f3-5da1b0ae2f5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:05.885511 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-51a9a582-d903-4325-85f3-5da1b0ae2f5f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048752 Jul 04 06:03:05.886081 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 585/1167] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:05 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:06.006080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-49278357-fcd2-4dd0-8e0c-1663403e3464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:06.006703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-49278357-fcd2-4dd0-8e0c-1663403e3464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:06.016152 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49278357-fcd2-4dd0-8e0c-1663403e3464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:06.016614 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49278357-fcd2-4dd0-8e0c-1663403e3464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:06.017386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49278357-fcd2-4dd0-8e0c-1663403e3464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:06.017859 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49278357-fcd2-4dd0-8e0c-1663403e3464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:06.308232 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-49278357-fcd2-4dd0-8e0c-1663403e3464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:06.318209 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-49278357-fcd2-4dd0-8e0c-1663403e3464 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.317801 Jul 04 06:03:06.318764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 583/1168] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:05 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:06.901882 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e5e465c2-451d-4818-8a1d-14d083f413c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:06.903316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e5e465c2-451d-4818-8a1d-14d083f413c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:06.915007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5e465c2-451d-4818-8a1d-14d083f413c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:06.915817 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5e465c2-451d-4818-8a1d-14d083f413c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:06.917088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5e465c2-451d-4818-8a1d-14d083f413c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:06.917815 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5e465c2-451d-4818-8a1d-14d083f413c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:06.948625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e5e465c2-451d-4818-8a1d-14d083f413c5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053646 Jul 04 06:03:06.949172 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 586/1169] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:07.343867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cd76d1cf-1d7b-414d-93cb-f9bc59d49d6e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:07.344663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cd76d1cf-1d7b-414d-93cb-f9bc59d49d6e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:07.353052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd76d1cf-1d7b-414d-93cb-f9bc59d49d6e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:07.353512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd76d1cf-1d7b-414d-93cb-f9bc59d49d6e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:07.354280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd76d1cf-1d7b-414d-93cb-f9bc59d49d6e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:07.354717 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd76d1cf-1d7b-414d-93cb-f9bc59d49d6e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:07.417965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cd76d1cf-1d7b-414d-93cb-f9bc59d49d6e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:07.425628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cd76d1cf-1d7b-414d-93cb-f9bc59d49d6e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.088234 Jul 04 06:03:07.426188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 584/1170] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:07 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:07.964745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7d591a8b-6a0e-42ff-a632-8b15aab757ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:07.966274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7d591a8b-6a0e-42ff-a632-8b15aab757ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:07.974648 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d591a8b-6a0e-42ff-a632-8b15aab757ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:07.975104 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d591a8b-6a0e-42ff-a632-8b15aab757ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:07.975893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d591a8b-6a0e-42ff-a632-8b15aab757ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:07.976325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d591a8b-6a0e-42ff-a632-8b15aab757ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:08.005762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7d591a8b-6a0e-42ff-a632-8b15aab757ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047817 Jul 04 06:03:08.006317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 587/1171] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:08.446927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-420e3cc2-ac20-4479-bdff-9b8fc8d9efd8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:08.447909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-420e3cc2-ac20-4479-bdff-9b8fc8d9efd8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:08.459553 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-420e3cc2-ac20-4479-bdff-9b8fc8d9efd8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:08.460309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-420e3cc2-ac20-4479-bdff-9b8fc8d9efd8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:08.461582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-420e3cc2-ac20-4479-bdff-9b8fc8d9efd8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:08.462312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-420e3cc2-ac20-4479-bdff-9b8fc8d9efd8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:08.527410 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-420e3cc2-ac20-4479-bdff-9b8fc8d9efd8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:08.535683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-420e3cc2-ac20-4479-bdff-9b8fc8d9efd8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.095284 Jul 04 06:03:08.536219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 585/1172] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:08 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:09.022101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-19be0ba2-29f6-4df3-a0d2-91abecb34068 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:09.023686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-19be0ba2-29f6-4df3-a0d2-91abecb34068 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:09.034798 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19be0ba2-29f6-4df3-a0d2-91abecb34068 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:09.035617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19be0ba2-29f6-4df3-a0d2-91abecb34068 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:09.036875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19be0ba2-29f6-4df3-a0d2-91abecb34068 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:09.037651 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19be0ba2-29f6-4df3-a0d2-91abecb34068 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:09.067209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:09.072194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-19be0ba2-29f6-4df3-a0d2-91abecb34068 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057073 Jul 04 06:03:09.072774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 588/1173] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:09.553696 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e9c3eb1d-4ae3-4659-ac29-e2c0d031c418 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:09.554249 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e9c3eb1d-4ae3-4659-ac29-e2c0d031c418 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:09.561507 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9c3eb1d-4ae3-4659-ac29-e2c0d031c418 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:09.561959 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9c3eb1d-4ae3-4659-ac29-e2c0d031c418 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:09.562724 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9c3eb1d-4ae3-4659-ac29-e2c0d031c418 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:09.563158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9c3eb1d-4ae3-4659-ac29-e2c0d031c418 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:09.628805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e9c3eb1d-4ae3-4659-ac29-e2c0d031c418 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:09.637086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e9c3eb1d-4ae3-4659-ac29-e2c0d031c418 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.087405 Jul 04 06:03:09.637995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 586/1174] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:09 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:10.090039 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b6e2ac6d-3c99-448e-9000-4b55555e7248 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:10.091570 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b6e2ac6d-3c99-448e-9000-4b55555e7248 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:10.099888 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6e2ac6d-3c99-448e-9000-4b55555e7248 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:10.100387 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6e2ac6d-3c99-448e-9000-4b55555e7248 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:10.101231 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6e2ac6d-3c99-448e-9000-4b55555e7248 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:10.101716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6e2ac6d-3c99-448e-9000-4b55555e7248 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:10.135747 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b6e2ac6d-3c99-448e-9000-4b55555e7248 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054121 Jul 04 06:03:10.136306 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 589/1175] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:10 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:10.659016 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c07dbf61-59f4-4cb7-998b-8569d6045ec4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:10.660048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c07dbf61-59f4-4cb7-998b-8569d6045ec4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:10.670889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c07dbf61-59f4-4cb7-998b-8569d6045ec4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:10.671697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c07dbf61-59f4-4cb7-998b-8569d6045ec4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:10.672968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c07dbf61-59f4-4cb7-998b-8569d6045ec4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:10.673547 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c07dbf61-59f4-4cb7-998b-8569d6045ec4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:10.740087 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c07dbf61-59f4-4cb7-998b-8569d6045ec4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:10.747568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c07dbf61-59f4-4cb7-998b-8569d6045ec4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.095618 Jul 04 06:03:10.748110 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 587/1176] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:10 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:11.147724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4bc1816a-176a-45d9-b780-e567999dadf3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:11.148659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4bc1816a-176a-45d9-b780-e567999dadf3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:11.155852 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc1816a-176a-45d9-b780-e567999dadf3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:11.156239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc1816a-176a-45d9-b780-e567999dadf3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:11.157039 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc1816a-176a-45d9-b780-e567999dadf3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:11.157506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc1816a-176a-45d9-b780-e567999dadf3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:11.188308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4bc1816a-176a-45d9-b780-e567999dadf3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Jul 04 06:03:11.188741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 590/1177] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:11 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:11.763760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e411fed2-61c0-46bf-9ce0-0dc8595cad58 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:11.764463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e411fed2-61c0-46bf-9ce0-0dc8595cad58 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:11.771197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e411fed2-61c0-46bf-9ce0-0dc8595cad58 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:11.771508 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e411fed2-61c0-46bf-9ce0-0dc8595cad58 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:11.772328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e411fed2-61c0-46bf-9ce0-0dc8595cad58 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:11.772707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e411fed2-61c0-46bf-9ce0-0dc8595cad58 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:11.834395 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e411fed2-61c0-46bf-9ce0-0dc8595cad58 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:11.843526 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e411fed2-61c0-46bf-9ce0-0dc8595cad58 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.083542 Jul 04 06:03:11.844083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 588/1178] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:11 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:12.208764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-25ca7936-d96a-4281-a208-ee451ea4023d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:12.209703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-25ca7936-d96a-4281-a208-ee451ea4023d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:12.216991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25ca7936-d96a-4281-a208-ee451ea4023d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:12.217673 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25ca7936-d96a-4281-a208-ee451ea4023d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:12.218847 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25ca7936-d96a-4281-a208-ee451ea4023d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:12.219336 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25ca7936-d96a-4281-a208-ee451ea4023d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:12.249453 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-25ca7936-d96a-4281-a208-ee451ea4023d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052082 Jul 04 06:03:12.250037 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 591/1179] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:12 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:12.860331 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a3b28cfe-0ab8-48d1-b1e5-e79d551e14c9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:12.860923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a3b28cfe-0ab8-48d1-b1e5-e79d551e14c9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:12.867923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3b28cfe-0ab8-48d1-b1e5-e79d551e14c9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:12.868378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3b28cfe-0ab8-48d1-b1e5-e79d551e14c9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:12.869152 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3b28cfe-0ab8-48d1-b1e5-e79d551e14c9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:12.869592 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3b28cfe-0ab8-48d1-b1e5-e79d551e14c9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:12.932136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a3b28cfe-0ab8-48d1-b1e5-e79d551e14c9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:12.940153 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a3b28cfe-0ab8-48d1-b1e5-e79d551e14c9 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.083716 Jul 04 06:03:12.940893 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 589/1180] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:12 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:13.265424 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c1b5dea9-358b-4ec9-8c69-ffcab6dece13 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:13.266565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c1b5dea9-358b-4ec9-8c69-ffcab6dece13 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:13.274067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1b5dea9-358b-4ec9-8c69-ffcab6dece13 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:13.274516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1b5dea9-358b-4ec9-8c69-ffcab6dece13 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:13.275275 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1b5dea9-358b-4ec9-8c69-ffcab6dece13 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:13.275741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1b5dea9-358b-4ec9-8c69-ffcab6dece13 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:13.307265 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c1b5dea9-358b-4ec9-8c69-ffcab6dece13 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048587 Jul 04 06:03:13.307853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 592/1181] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:13 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:13.957493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-709aea31-c741-4310-bebb-bc58943d0dc7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:13.958088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-709aea31-c741-4310-bebb-bc58943d0dc7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:13.965445 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-709aea31-c741-4310-bebb-bc58943d0dc7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:13.965890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-709aea31-c741-4310-bebb-bc58943d0dc7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:13.966651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-709aea31-c741-4310-bebb-bc58943d0dc7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:13.967077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-709aea31-c741-4310-bebb-bc58943d0dc7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:14.036473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-709aea31-c741-4310-bebb-bc58943d0dc7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:14.044110 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-709aea31-c741-4310-bebb-bc58943d0dc7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090718 Jul 04 06:03:14.044812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 590/1182] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:13 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:14.320514 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-157f1b95-424c-4722-9053-5fcb35fd372f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:14.321325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-157f1b95-424c-4722-9053-5fcb35fd372f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:14.328281 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-157f1b95-424c-4722-9053-5fcb35fd372f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:14.328724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-157f1b95-424c-4722-9053-5fcb35fd372f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:14.329479 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-157f1b95-424c-4722-9053-5fcb35fd372f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:14.329906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-157f1b95-424c-4722-9053-5fcb35fd372f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:14.359916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-157f1b95-424c-4722-9053-5fcb35fd372f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Jul 04 06:03:14.360462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 593/1183] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:14 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:15.065050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-91154860-dab7-4a74-9b5b-7dc42eb57ad7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:15.066091 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-91154860-dab7-4a74-9b5b-7dc42eb57ad7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:15.073577 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91154860-dab7-4a74-9b5b-7dc42eb57ad7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:15.074085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91154860-dab7-4a74-9b5b-7dc42eb57ad7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:15.074897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91154860-dab7-4a74-9b5b-7dc42eb57ad7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:15.075406 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91154860-dab7-4a74-9b5b-7dc42eb57ad7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:15.139566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-91154860-dab7-4a74-9b5b-7dc42eb57ad7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:15.147477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-91154860-dab7-4a74-9b5b-7dc42eb57ad7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.088916 Jul 04 06:03:15.148036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 591/1184] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:15 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:15.375939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ef28eb00-ba70-4198-9d4d-4749ef710c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:15.377471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ef28eb00-ba70-4198-9d4d-4749ef710c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:15.384980 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef28eb00-ba70-4198-9d4d-4749ef710c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:15.385428 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef28eb00-ba70-4198-9d4d-4749ef710c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:15.386193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef28eb00-ba70-4198-9d4d-4749ef710c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:15.386628 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef28eb00-ba70-4198-9d4d-4749ef710c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:15.416534 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ef28eb00-ba70-4198-9d4d-4749ef710c59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047319 Jul 04 06:03:15.417080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 594/1185] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:16.169061 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fefcd184-85ea-4784-b15d-625ea3cd9003 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:16.170074 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fefcd184-85ea-4784-b15d-625ea3cd9003 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:16.180545 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fefcd184-85ea-4784-b15d-625ea3cd9003 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:16.181640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fefcd184-85ea-4784-b15d-625ea3cd9003 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:16.182925 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fefcd184-85ea-4784-b15d-625ea3cd9003 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:16.183735 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fefcd184-85ea-4784-b15d-625ea3cd9003 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:16.248038 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fefcd184-85ea-4784-b15d-625ea3cd9003 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:16.257558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fefcd184-85ea-4784-b15d-625ea3cd9003 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.095143 Jul 04 06:03:16.258154 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 592/1186] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:16 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:16.431160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5f6b9b90-1ff6-4345-b1a4-0fc8e122ecb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:16.432500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5f6b9b90-1ff6-4345-b1a4-0fc8e122ecb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:16.442331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f6b9b90-1ff6-4345-b1a4-0fc8e122ecb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:16.442975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f6b9b90-1ff6-4345-b1a4-0fc8e122ecb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:16.444115 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f6b9b90-1ff6-4345-b1a4-0fc8e122ecb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:16.444740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f6b9b90-1ff6-4345-b1a4-0fc8e122ecb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:16.478169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5f6b9b90-1ff6-4345-b1a4-0fc8e122ecb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052703 Jul 04 06:03:16.478691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 595/1187] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:17.277368 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-04251ed0-1db1-479a-8ad7-89094218a48c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:17.278270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-04251ed0-1db1-479a-8ad7-89094218a48c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:17.289020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04251ed0-1db1-479a-8ad7-89094218a48c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:17.289610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04251ed0-1db1-479a-8ad7-89094218a48c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:17.290741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04251ed0-1db1-479a-8ad7-89094218a48c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:17.291489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04251ed0-1db1-479a-8ad7-89094218a48c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:17.356451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-04251ed0-1db1-479a-8ad7-89094218a48c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:17.366108 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-04251ed0-1db1-479a-8ad7-89094218a48c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.094914 Jul 04 06:03:17.366694 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 593/1188] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:17 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:17.494749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-19f41a9d-48a6-43b8-b98c-d655089d64b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:17.496282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-19f41a9d-48a6-43b8-b98c-d655089d64b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:17.506494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19f41a9d-48a6-43b8-b98c-d655089d64b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:17.506941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19f41a9d-48a6-43b8-b98c-d655089d64b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:17.507850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19f41a9d-48a6-43b8-b98c-d655089d64b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:17.508284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19f41a9d-48a6-43b8-b98c-d655089d64b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:17.537840 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-19f41a9d-48a6-43b8-b98c-d655089d64b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049714 Jul 04 06:03:17.538390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 596/1189] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:18.382860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f55e8cfb-78e0-418b-8034-8ddc0057d67e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:18.383453 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f55e8cfb-78e0-418b-8034-8ddc0057d67e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:18.390436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f55e8cfb-78e0-418b-8034-8ddc0057d67e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:18.390915 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f55e8cfb-78e0-418b-8034-8ddc0057d67e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:18.391736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f55e8cfb-78e0-418b-8034-8ddc0057d67e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:18.392173 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f55e8cfb-78e0-418b-8034-8ddc0057d67e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:18.455725 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f55e8cfb-78e0-418b-8034-8ddc0057d67e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:18.463469 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f55e8cfb-78e0-418b-8034-8ddc0057d67e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.084643 Jul 04 06:03:18.464035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 594/1190] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:18 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:18.550894 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-142e80bf-5583-4f90-b419-2cfc56f6c211 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:18.552042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-142e80bf-5583-4f90-b419-2cfc56f6c211 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:18.558467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-142e80bf-5583-4f90-b419-2cfc56f6c211 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:18.558916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-142e80bf-5583-4f90-b419-2cfc56f6c211 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:18.559805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-142e80bf-5583-4f90-b419-2cfc56f6c211 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:18.560238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-142e80bf-5583-4f90-b419-2cfc56f6c211 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:18.590437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-142e80bf-5583-4f90-b419-2cfc56f6c211 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044602 Jul 04 06:03:18.591009 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 597/1191] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:19.484340 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8c870f3c-c1a6-4afe-9663-a3790fb97e24 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:19.485351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8c870f3c-c1a6-4afe-9663-a3790fb97e24 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:19.496549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c870f3c-c1a6-4afe-9663-a3790fb97e24 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:19.497332 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c870f3c-c1a6-4afe-9663-a3790fb97e24 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:19.498598 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c870f3c-c1a6-4afe-9663-a3790fb97e24 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:19.499422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c870f3c-c1a6-4afe-9663-a3790fb97e24 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:19.564872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8c870f3c-c1a6-4afe-9663-a3790fb97e24 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:19.572587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8c870f3c-c1a6-4afe-9663-a3790fb97e24 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.094748 Jul 04 06:03:19.573146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 595/1192] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:19 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:19.606128 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9baa38d5-09d6-42e6-a0cd-ff0ed6bf92c3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:19.607555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9baa38d5-09d6-42e6-a0cd-ff0ed6bf92c3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:19.617555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9baa38d5-09d6-42e6-a0cd-ff0ed6bf92c3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:19.618001 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9baa38d5-09d6-42e6-a0cd-ff0ed6bf92c3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:19.618750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9baa38d5-09d6-42e6-a0cd-ff0ed6bf92c3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:19.619176 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9baa38d5-09d6-42e6-a0cd-ff0ed6bf92c3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:19.649360 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9baa38d5-09d6-42e6-a0cd-ff0ed6bf92c3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050210 Jul 04 06:03:19.649910 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 598/1193] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:20.594353 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3db99684-ce7b-44fa-b060-ffa59886a3a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:20.594995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3db99684-ce7b-44fa-b060-ffa59886a3a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:20.601977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3db99684-ce7b-44fa-b060-ffa59886a3a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:20.602471 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3db99684-ce7b-44fa-b060-ffa59886a3a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:20.603211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3db99684-ce7b-44fa-b060-ffa59886a3a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:20.603678 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3db99684-ce7b-44fa-b060-ffa59886a3a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:20.622481 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:20.661536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8abea356-7593-48c2-b1a5-c202992f0fc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:20.662466 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8abea356-7593-48c2-b1a5-c202992f0fc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:20.665788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3db99684-ce7b-44fa-b060-ffa59886a3a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:20.669856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8abea356-7593-48c2-b1a5-c202992f0fc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:20.670313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8abea356-7593-48c2-b1a5-c202992f0fc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:20.671098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8abea356-7593-48c2-b1a5-c202992f0fc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:20.671565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8abea356-7593-48c2-b1a5-c202992f0fc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:20.673772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3db99684-ce7b-44fa-b060-ffa59886a3a7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.083422 Jul 04 06:03:20.674349 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 596/1194] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:20 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:20.702057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8abea356-7593-48c2-b1a5-c202992f0fc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044497 Jul 04 06:03:20.702604 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 599/1195] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:20 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:21.694168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-38485bb8-b8dd-4410-a313-b856999be349 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:21.695222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-38485bb8-b8dd-4410-a313-b856999be349 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:21.706398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38485bb8-b8dd-4410-a313-b856999be349 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:21.707149 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38485bb8-b8dd-4410-a313-b856999be349 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:21.708484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38485bb8-b8dd-4410-a313-b856999be349 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:21.709244 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38485bb8-b8dd-4410-a313-b856999be349 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:21.717100 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-02c53d84-35c1-4b4c-832f-b514e803fdbd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:21.718113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-02c53d84-35c1-4b4c-832f-b514e803fdbd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:21.720601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=58 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:21.726157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c53d84-35c1-4b4c-832f-b514e803fdbd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:21.726608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c53d84-35c1-4b4c-832f-b514e803fdbd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:21.727406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c53d84-35c1-4b4c-832f-b514e803fdbd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:21.727846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c53d84-35c1-4b4c-832f-b514e803fdbd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:21.760956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-02c53d84-35c1-4b4c-832f-b514e803fdbd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048278 Jul 04 06:03:21.761557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 600/1196] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:21.777336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-38485bb8-b8dd-4410-a313-b856999be349 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:21.786693 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-38485bb8-b8dd-4410-a313-b856999be349 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.099129 Jul 04 06:03:21.787687 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 597/1197] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:21 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:22.777409 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8b85ccf9-6a8d-4e73-b8a0-a4d8139431e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:22.778782 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8b85ccf9-6a8d-4e73-b8a0-a4d8139431e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:22.790097 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b85ccf9-6a8d-4e73-b8a0-a4d8139431e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:22.790845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b85ccf9-6a8d-4e73-b8a0-a4d8139431e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:22.791823 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b85ccf9-6a8d-4e73-b8a0-a4d8139431e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:22.792281 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b85ccf9-6a8d-4e73-b8a0-a4d8139431e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:22.805458 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe6e2e66-0fba-4685-a0f1-2c4f7217fb59 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:22.806042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe6e2e66-0fba-4685-a0f1-2c4f7217fb59 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:22.812916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe6e2e66-0fba-4685-a0f1-2c4f7217fb59 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:22.813375 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe6e2e66-0fba-4685-a0f1-2c4f7217fb59 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:22.814146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe6e2e66-0fba-4685-a0f1-2c4f7217fb59 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:22.814828 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe6e2e66-0fba-4685-a0f1-2c4f7217fb59 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:22.823068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8b85ccf9-6a8d-4e73-b8a0-a4d8139431e6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052657 Jul 04 06:03:22.823679 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 601/1198] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:22.876142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe6e2e66-0fba-4685-a0f1-2c4f7217fb59 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:22.884102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe6e2e66-0fba-4685-a0f1-2c4f7217fb59 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.082538 Jul 04 06:03:22.884707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 598/1199] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:22 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:23.838878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4bf0afe2-bc64-40f1-aa47-148b0a61ab3e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:23.840022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4bf0afe2-bc64-40f1-aa47-148b0a61ab3e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:23.847829 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bf0afe2-bc64-40f1-aa47-148b0a61ab3e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:23.848335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bf0afe2-bc64-40f1-aa47-148b0a61ab3e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:23.849184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bf0afe2-bc64-40f1-aa47-148b0a61ab3e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:23.849673 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bf0afe2-bc64-40f1-aa47-148b0a61ab3e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:23.881412 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4bf0afe2-bc64-40f1-aa47-148b0a61ab3e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049099 Jul 04 06:03:23.881967 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 602/1200] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:23.901254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ec566e7e-2429-4e8f-a852-3b305811dc40 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:23.901862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ec566e7e-2429-4e8f-a852-3b305811dc40 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:23.909060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec566e7e-2429-4e8f-a852-3b305811dc40 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:23.909511 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec566e7e-2429-4e8f-a852-3b305811dc40 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:23.910250 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec566e7e-2429-4e8f-a852-3b305811dc40 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:23.910682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec566e7e-2429-4e8f-a852-3b305811dc40 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:23.980812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ec566e7e-2429-4e8f-a852-3b305811dc40 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:23.990725 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ec566e7e-2429-4e8f-a852-3b305811dc40 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.093224 Jul 04 06:03:23.991495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 599/1201] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:23 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:24.896293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-73927228-1c22-4c85-9730-30cbebcf040e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:24.897393 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-73927228-1c22-4c85-9730-30cbebcf040e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:24.905949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73927228-1c22-4c85-9730-30cbebcf040e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:24.906480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73927228-1c22-4c85-9730-30cbebcf040e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:24.907431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73927228-1c22-4c85-9730-30cbebcf040e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:24.907948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73927228-1c22-4c85-9730-30cbebcf040e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:24.938832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-73927228-1c22-4c85-9730-30cbebcf040e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Jul 04 06:03:24.939426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 603/1202] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:25.011961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-85a8fb7e-6224-4009-89b9-d9ae2af2d1de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:25.013040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-85a8fb7e-6224-4009-89b9-d9ae2af2d1de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:25.023980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85a8fb7e-6224-4009-89b9-d9ae2af2d1de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:25.024720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85a8fb7e-6224-4009-89b9-d9ae2af2d1de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:25.026158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85a8fb7e-6224-4009-89b9-d9ae2af2d1de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:25.026877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85a8fb7e-6224-4009-89b9-d9ae2af2d1de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:25.095517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-85a8fb7e-6224-4009-89b9-d9ae2af2d1de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:25.103053 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-85a8fb7e-6224-4009-89b9-d9ae2af2d1de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.097706 Jul 04 06:03:25.103759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 600/1203] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:25 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:25.955346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d329bc61-edde-465d-b3e1-26ba7c3051b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:25.956716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d329bc61-edde-465d-b3e1-26ba7c3051b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:25.965973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d329bc61-edde-465d-b3e1-26ba7c3051b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:25.966422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d329bc61-edde-465d-b3e1-26ba7c3051b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:25.967188 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d329bc61-edde-465d-b3e1-26ba7c3051b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:25.967657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d329bc61-edde-465d-b3e1-26ba7c3051b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:25.997361 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d329bc61-edde-465d-b3e1-26ba7c3051b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048915 Jul 04 06:03:25.997923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 604/1204] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:26.124003 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0c47048f-89a0-46b0-ba7a-866295a90f2c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:26.124974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0c47048f-89a0-46b0-ba7a-866295a90f2c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:26.135684 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c47048f-89a0-46b0-ba7a-866295a90f2c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:26.136412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c47048f-89a0-46b0-ba7a-866295a90f2c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:26.137671 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c47048f-89a0-46b0-ba7a-866295a90f2c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:26.138380 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c47048f-89a0-46b0-ba7a-866295a90f2c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:26.210791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0c47048f-89a0-46b0-ba7a-866295a90f2c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:26.218708 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0c47048f-89a0-46b0-ba7a-866295a90f2c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.101279 Jul 04 06:03:26.219220 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 601/1205] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:26 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:27.013744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7a368c45-bdeb-4a52-86bb-16cbd9bdfc49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:27.015343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7a368c45-bdeb-4a52-86bb-16cbd9bdfc49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:27.026113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a368c45-bdeb-4a52-86bb-16cbd9bdfc49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:27.026563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a368c45-bdeb-4a52-86bb-16cbd9bdfc49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:27.027334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a368c45-bdeb-4a52-86bb-16cbd9bdfc49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:27.027805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a368c45-bdeb-4a52-86bb-16cbd9bdfc49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:27.045876 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:27.059590 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7a368c45-bdeb-4a52-86bb-16cbd9bdfc49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052647 Jul 04 06:03:27.060162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 605/1206] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:27.236311 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e026a57d-1282-48c3-9eb7-813367e0bc2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:27.236923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e026a57d-1282-48c3-9eb7-813367e0bc2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:27.244209 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e026a57d-1282-48c3-9eb7-813367e0bc2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:27.244518 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e026a57d-1282-48c3-9eb7-813367e0bc2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:27.245192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e026a57d-1282-48c3-9eb7-813367e0bc2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:27.245622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e026a57d-1282-48c3-9eb7-813367e0bc2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:27.308332 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e026a57d-1282-48c3-9eb7-813367e0bc2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:27.316076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e026a57d-1282-48c3-9eb7-813367e0bc2a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.084423 Jul 04 06:03:27.316631 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 602/1207] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:27 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:28.074221 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-12a08b0c-fc32-430a-961b-38038260983e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:28.075288 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-12a08b0c-fc32-430a-961b-38038260983e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:28.084602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12a08b0c-fc32-430a-961b-38038260983e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:28.085074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12a08b0c-fc32-430a-961b-38038260983e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:28.085894 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12a08b0c-fc32-430a-961b-38038260983e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:28.086355 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12a08b0c-fc32-430a-961b-38038260983e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:28.117712 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-12a08b0c-fc32-430a-961b-38038260983e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049197 Jul 04 06:03:28.118283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 606/1208] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:28.333245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad8379ae-5836-4685-a3d9-92d419666cbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:28.333955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ad8379ae-5836-4685-a3d9-92d419666cbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:28.336402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=54 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:28.342075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad8379ae-5836-4685-a3d9-92d419666cbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:28.342528 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad8379ae-5836-4685-a3d9-92d419666cbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:28.343342 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad8379ae-5836-4685-a3d9-92d419666cbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:28.343854 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad8379ae-5836-4685-a3d9-92d419666cbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:28.417660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad8379ae-5836-4685-a3d9-92d419666cbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:28.430791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ad8379ae-5836-4685-a3d9-92d419666cbe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.101761 Jul 04 06:03:28.432468 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 603/1209] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:28 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:29.133813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-18347be9-ffbd-45da-a750-877f811d5d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:29.135331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-18347be9-ffbd-45da-a750-877f811d5d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:29.146205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18347be9-ffbd-45da-a750-877f811d5d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:29.146946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18347be9-ffbd-45da-a750-877f811d5d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:29.148260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18347be9-ffbd-45da-a750-877f811d5d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:29.148980 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18347be9-ffbd-45da-a750-877f811d5d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:29.179971 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-18347be9-ffbd-45da-a750-877f811d5d30 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052828 Jul 04 06:03:29.180513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 607/1210] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:29.456546 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f749efc2-afb5-4a98-ae14-edc9b4703fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:29.457376 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f749efc2-afb5-4a98-ae14-edc9b4703fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:29.467337 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f749efc2-afb5-4a98-ae14-edc9b4703fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:29.468017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f749efc2-afb5-4a98-ae14-edc9b4703fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:29.469191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f749efc2-afb5-4a98-ae14-edc9b4703fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:29.469843 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f749efc2-afb5-4a98-ae14-edc9b4703fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:29.534089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f749efc2-afb5-4a98-ae14-edc9b4703fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:29.541712 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f749efc2-afb5-4a98-ae14-edc9b4703fec tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091240 Jul 04 06:03:29.542274 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 604/1211] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:29 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:30.196124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-45e95f41-904b-467a-a871-c669eb752421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:30.197757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-45e95f41-904b-467a-a871-c669eb752421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:30.204225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45e95f41-904b-467a-a871-c669eb752421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:30.204679 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45e95f41-904b-467a-a871-c669eb752421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:30.205567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45e95f41-904b-467a-a871-c669eb752421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:30.205964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45e95f41-904b-467a-a871-c669eb752421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:30.237476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-45e95f41-904b-467a-a871-c669eb752421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048227 Jul 04 06:03:30.238036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 608/1212] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:30 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:30.558586 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dd8c0236-5bf6-4cd0-a322-9ede1b80a8de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:30.559190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dd8c0236-5bf6-4cd0-a322-9ede1b80a8de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:30.566102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd8c0236-5bf6-4cd0-a322-9ede1b80a8de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:30.566553 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd8c0236-5bf6-4cd0-a322-9ede1b80a8de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:30.567353 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd8c0236-5bf6-4cd0-a322-9ede1b80a8de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:30.567791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd8c0236-5bf6-4cd0-a322-9ede1b80a8de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:30.629587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dd8c0236-5bf6-4cd0-a322-9ede1b80a8de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:30.641011 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dd8c0236-5bf6-4cd0-a322-9ede1b80a8de tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.086181 Jul 04 06:03:30.641737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 605/1213] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:30 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:31.250467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3a730055-197b-4702-bcac-b2831ba88578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:31.251432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3a730055-197b-4702-bcac-b2831ba88578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:31.258335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a730055-197b-4702-bcac-b2831ba88578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:31.258786 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a730055-197b-4702-bcac-b2831ba88578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:31.259599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a730055-197b-4702-bcac-b2831ba88578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:31.260036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a730055-197b-4702-bcac-b2831ba88578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:31.298923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3a730055-197b-4702-bcac-b2831ba88578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052047 Jul 04 06:03:31.299863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 609/1214] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:31 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:31.662150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3a81a5cc-aec4-41c9-9c16-9dd22ca2467a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:31.663210 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3a81a5cc-aec4-41c9-9c16-9dd22ca2467a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:31.671764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a81a5cc-aec4-41c9-9c16-9dd22ca2467a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:31.672216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a81a5cc-aec4-41c9-9c16-9dd22ca2467a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:31.672989 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a81a5cc-aec4-41c9-9c16-9dd22ca2467a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:31.673427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a81a5cc-aec4-41c9-9c16-9dd22ca2467a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:31.745535 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3a81a5cc-aec4-41c9-9c16-9dd22ca2467a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:31.753294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3a81a5cc-aec4-41c9-9c16-9dd22ca2467a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.097632 Jul 04 06:03:31.753854 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 606/1215] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:31 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:32.317076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-172bb491-3e44-490f-86b3-cd181bc978ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:32.318560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-172bb491-3e44-490f-86b3-cd181bc978ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:32.327459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-172bb491-3e44-490f-86b3-cd181bc978ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:32.327914 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-172bb491-3e44-490f-86b3-cd181bc978ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:32.328674 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-172bb491-3e44-490f-86b3-cd181bc978ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:32.329105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-172bb491-3e44-490f-86b3-cd181bc978ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:32.357607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-172bb491-3e44-490f-86b3-cd181bc978ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047262 Jul 04 06:03:32.358153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 610/1216] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:32 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:32.774460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a7e2de73-5ec0-49f1-8b18-7d013010569e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:32.775371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a7e2de73-5ec0-49f1-8b18-7d013010569e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:32.782981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7e2de73-5ec0-49f1-8b18-7d013010569e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:32.783463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7e2de73-5ec0-49f1-8b18-7d013010569e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:32.784225 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7e2de73-5ec0-49f1-8b18-7d013010569e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:32.784652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7e2de73-5ec0-49f1-8b18-7d013010569e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:32.856764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a7e2de73-5ec0-49f1-8b18-7d013010569e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:32.864649 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a7e2de73-5ec0-49f1-8b18-7d013010569e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.096940 Jul 04 06:03:32.865184 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 607/1217] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:32 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:33.375452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9ea66c78-ef43-4122-9101-b61d441183d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:33.376992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9ea66c78-ef43-4122-9101-b61d441183d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:33.387179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ea66c78-ef43-4122-9101-b61d441183d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:33.387668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ea66c78-ef43-4122-9101-b61d441183d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:33.388436 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ea66c78-ef43-4122-9101-b61d441183d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:33.388904 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ea66c78-ef43-4122-9101-b61d441183d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:33.418764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9ea66c78-ef43-4122-9101-b61d441183d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050115 Jul 04 06:03:33.419344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 611/1218] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:33.885878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c772132d-ea0c-4326-a3dd-9e32ffadf1df tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:33.886536 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c772132d-ea0c-4326-a3dd-9e32ffadf1df tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:33.894176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c772132d-ea0c-4326-a3dd-9e32ffadf1df tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:33.894671 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c772132d-ea0c-4326-a3dd-9e32ffadf1df tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:33.895576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c772132d-ea0c-4326-a3dd-9e32ffadf1df tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:33.896064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c772132d-ea0c-4326-a3dd-9e32ffadf1df tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:33.961966 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c772132d-ea0c-4326-a3dd-9e32ffadf1df tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:33.971392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c772132d-ea0c-4326-a3dd-9e32ffadf1df tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091686 Jul 04 06:03:33.971932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 608/1219] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:33 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:34.435349 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7c49ce54-43f1-429d-a173-09f039badad7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:34.436798 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7c49ce54-43f1-429d-a173-09f039badad7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:34.447823 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c49ce54-43f1-429d-a173-09f039badad7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:34.448545 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c49ce54-43f1-429d-a173-09f039badad7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:34.449848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c49ce54-43f1-429d-a173-09f039badad7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:34.450548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c49ce54-43f1-429d-a173-09f039badad7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:34.485289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7c49ce54-43f1-429d-a173-09f039badad7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056991 Jul 04 06:03:34.485841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 612/1220] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:34.991550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d80c76a3-c391-4e59-88e4-9bc0769437c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:34.992575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d80c76a3-c391-4e59-88e4-9bc0769437c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:35.000143 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d80c76a3-c391-4e59-88e4-9bc0769437c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:35.000788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d80c76a3-c391-4e59-88e4-9bc0769437c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:35.001355 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d80c76a3-c391-4e59-88e4-9bc0769437c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:35.001795 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d80c76a3-c391-4e59-88e4-9bc0769437c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:35.062454 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d80c76a3-c391-4e59-88e4-9bc0769437c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:35.070104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d80c76a3-c391-4e59-88e4-9bc0769437c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.085102 Jul 04 06:03:35.070638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 609/1221] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:34 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:35.501111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-786687be-fa63-40e7-ae77-3fb1eb3b33c1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:35.502657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-786687be-fa63-40e7-ae77-3fb1eb3b33c1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:35.512642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-786687be-fa63-40e7-ae77-3fb1eb3b33c1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:35.513090 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-786687be-fa63-40e7-ae77-3fb1eb3b33c1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:35.513911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-786687be-fa63-40e7-ae77-3fb1eb3b33c1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:35.514322 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-786687be-fa63-40e7-ae77-3fb1eb3b33c1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:35.546233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-786687be-fa63-40e7-ae77-3fb1eb3b33c1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051995 Jul 04 06:03:35.546793 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 613/1222] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:36.089127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9a552bc2-1535-4b61-b44f-a3aa854085fd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:36.089816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9a552bc2-1535-4b61-b44f-a3aa854085fd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:36.101032 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a552bc2-1535-4b61-b44f-a3aa854085fd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:36.102316 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a552bc2-1535-4b61-b44f-a3aa854085fd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:36.103987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a552bc2-1535-4b61-b44f-a3aa854085fd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:36.104708 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a552bc2-1535-4b61-b44f-a3aa854085fd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:36.169606 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a552bc2-1535-4b61-b44f-a3aa854085fd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:36.181197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9a552bc2-1535-4b61-b44f-a3aa854085fd tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.097990 Jul 04 06:03:36.181792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 610/1223] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:36 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:36.560836 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b1f0f6f3-4ba8-408d-b219-25bfa7a757b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:36.561848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b1f0f6f3-4ba8-408d-b219-25bfa7a757b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:36.569047 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1f0f6f3-4ba8-408d-b219-25bfa7a757b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:36.569501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1f0f6f3-4ba8-408d-b219-25bfa7a757b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:36.570273 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1f0f6f3-4ba8-408d-b219-25bfa7a757b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:36.570705 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1f0f6f3-4ba8-408d-b219-25bfa7a757b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:36.600525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b1f0f6f3-4ba8-408d-b219-25bfa7a757b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044969 Jul 04 06:03:36.601087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 614/1224] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:37.201541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-abc07dae-f874-481a-b8c3-1c57774300a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:37.202924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-abc07dae-f874-481a-b8c3-1c57774300a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:37.213077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abc07dae-f874-481a-b8c3-1c57774300a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:37.213757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abc07dae-f874-481a-b8c3-1c57774300a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:37.214972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abc07dae-f874-481a-b8c3-1c57774300a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:37.215432 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abc07dae-f874-481a-b8c3-1c57774300a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:37.278812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-abc07dae-f874-481a-b8c3-1c57774300a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:37.287053 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-abc07dae-f874-481a-b8c3-1c57774300a3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091563 Jul 04 06:03:37.287665 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 611/1225] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:37 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:37.616422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3832c288-f119-4caa-91bd-9f6a624a9873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:37.617937 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3832c288-f119-4caa-91bd-9f6a624a9873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:37.629040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3832c288-f119-4caa-91bd-9f6a624a9873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:37.629771 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3832c288-f119-4caa-91bd-9f6a624a9873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:37.631120 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3832c288-f119-4caa-91bd-9f6a624a9873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:37.631872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3832c288-f119-4caa-91bd-9f6a624a9873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:37.663627 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3832c288-f119-4caa-91bd-9f6a624a9873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054055 Jul 04 06:03:37.664148 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 615/1226] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:38.306802 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe05a6c6-e086-4324-a195-e7118f64af1f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:38.307418 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe05a6c6-e086-4324-a195-e7118f64af1f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:38.317783 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe05a6c6-e086-4324-a195-e7118f64af1f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:38.318415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe05a6c6-e086-4324-a195-e7118f64af1f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:38.319666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe05a6c6-e086-4324-a195-e7118f64af1f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:38.320304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe05a6c6-e086-4324-a195-e7118f64af1f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:38.384501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe05a6c6-e086-4324-a195-e7118f64af1f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:38.392573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe05a6c6-e086-4324-a195-e7118f64af1f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091851 Jul 04 06:03:38.393182 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 612/1227] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:38 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:38.679288 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-75cf02e3-25bd-4586-8667-319a3d1e3a98 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:38.680842 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-75cf02e3-25bd-4586-8667-319a3d1e3a98 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:38.688411 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75cf02e3-25bd-4586-8667-319a3d1e3a98 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:38.688862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75cf02e3-25bd-4586-8667-319a3d1e3a98 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:38.689619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75cf02e3-25bd-4586-8667-319a3d1e3a98 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:38.690052 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75cf02e3-25bd-4586-8667-319a3d1e3a98 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:38.718464 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-75cf02e3-25bd-4586-8667-319a3d1e3a98 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Jul 04 06:03:38.719036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 616/1228] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:39.411462 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fd0c6d90-325e-4171-b949-0ad5619f6427 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:39.412202 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fd0c6d90-325e-4171-b949-0ad5619f6427 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:39.421039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd0c6d90-325e-4171-b949-0ad5619f6427 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:39.421641 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd0c6d90-325e-4171-b949-0ad5619f6427 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:39.422661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd0c6d90-325e-4171-b949-0ad5619f6427 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:39.423284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd0c6d90-325e-4171-b949-0ad5619f6427 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:39.428639 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:39.490515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fd0c6d90-325e-4171-b949-0ad5619f6427 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:39.498458 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fd0c6d90-325e-4171-b949-0ad5619f6427 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092215 Jul 04 06:03:39.499000 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 613/1229] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:39 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:39.737377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4caca0e6-2bce-4e15-8e5d-56a4994c43ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:39.739035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4caca0e6-2bce-4e15-8e5d-56a4994c43ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:39.748431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4caca0e6-2bce-4e15-8e5d-56a4994c43ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:39.748891 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4caca0e6-2bce-4e15-8e5d-56a4994c43ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:39.749681 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4caca0e6-2bce-4e15-8e5d-56a4994c43ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:39.750120 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4caca0e6-2bce-4e15-8e5d-56a4994c43ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:39.779993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4caca0e6-2bce-4e15-8e5d-56a4994c43ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049016 Jul 04 06:03:39.780548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 617/1230] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:40.516642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba4a685b-244b-4f2b-b488-c6caf630a473 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:40.517352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba4a685b-244b-4f2b-b488-c6caf630a473 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:40.524199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4a685b-244b-4f2b-b488-c6caf630a473 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:40.524655 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4a685b-244b-4f2b-b488-c6caf630a473 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:40.525420 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4a685b-244b-4f2b-b488-c6caf630a473 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:40.525860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4a685b-244b-4f2b-b488-c6caf630a473 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:40.588959 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ba4a685b-244b-4f2b-b488-c6caf630a473 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:40.596851 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba4a685b-244b-4f2b-b488-c6caf630a473 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.084144 Jul 04 06:03:40.597379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 614/1231] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:40 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:40.796525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb7da17a-05e7-47e6-bf99-6813e80183e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:40.797956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bb7da17a-05e7-47e6-bf99-6813e80183e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:40.808818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb7da17a-05e7-47e6-bf99-6813e80183e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:40.809571 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb7da17a-05e7-47e6-bf99-6813e80183e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:40.810834 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb7da17a-05e7-47e6-bf99-6813e80183e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:40.811647 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb7da17a-05e7-47e6-bf99-6813e80183e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:40.846239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bb7da17a-05e7-47e6-bf99-6813e80183e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056885 Jul 04 06:03:40.846794 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 618/1232] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:41.618534 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8388ce89-b43e-4e68-9744-0a17bc0e66a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:41.619571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8388ce89-b43e-4e68-9744-0a17bc0e66a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:41.630745 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8388ce89-b43e-4e68-9744-0a17bc0e66a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:41.631546 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8388ce89-b43e-4e68-9744-0a17bc0e66a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:41.632804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8388ce89-b43e-4e68-9744-0a17bc0e66a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:41.633523 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8388ce89-b43e-4e68-9744-0a17bc0e66a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:41.701274 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8388ce89-b43e-4e68-9744-0a17bc0e66a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:41.711638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8388ce89-b43e-4e68-9744-0a17bc0e66a6 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.099695 Jul 04 06:03:41.712343 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 615/1233] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:41 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:41.858300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-653a69f7-4d04-4b21-9be1-36253fb43a0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:41.859168 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-653a69f7-4d04-4b21-9be1-36253fb43a0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:41.866055 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-653a69f7-4d04-4b21-9be1-36253fb43a0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:41.866512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-653a69f7-4d04-4b21-9be1-36253fb43a0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:41.867278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-653a69f7-4d04-4b21-9be1-36253fb43a0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:41.867747 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-653a69f7-4d04-4b21-9be1-36253fb43a0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:41.898396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-653a69f7-4d04-4b21-9be1-36253fb43a0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Jul 04 06:03:41.898960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 619/1234] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:41 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:42.732479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-51b681ad-f6b6-4784-8403-ef539cefcd5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:42.733473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-51b681ad-f6b6-4784-8403-ef539cefcd5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:42.744478 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51b681ad-f6b6-4784-8403-ef539cefcd5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:42.745234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51b681ad-f6b6-4784-8403-ef539cefcd5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:42.746499 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51b681ad-f6b6-4784-8403-ef539cefcd5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:42.747240 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51b681ad-f6b6-4784-8403-ef539cefcd5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:42.822032 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-51b681ad-f6b6-4784-8403-ef539cefcd5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:42.830138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-51b681ad-f6b6-4784-8403-ef539cefcd5f tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.104452 Jul 04 06:03:42.830675 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 616/1235] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:42 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:42.910701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7c7e653e-3d09-4c55-be15-7edbb1dd4398 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:42.911675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7c7e653e-3d09-4c55-be15-7edbb1dd4398 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:42.918737 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c7e653e-3d09-4c55-be15-7edbb1dd4398 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:42.919187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c7e653e-3d09-4c55-be15-7edbb1dd4398 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:42.919990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c7e653e-3d09-4c55-be15-7edbb1dd4398 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:42.920419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c7e653e-3d09-4c55-be15-7edbb1dd4398 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:42.950727 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7c7e653e-3d09-4c55-be15-7edbb1dd4398 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Jul 04 06:03:42.951277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 620/1236] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:42 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:43.851482 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-131d4e04-b1b1-464b-b958-fda92059f113 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:43.852579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-131d4e04-b1b1-464b-b958-fda92059f113 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:43.863747 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-131d4e04-b1b1-464b-b958-fda92059f113 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:43.864493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-131d4e04-b1b1-464b-b958-fda92059f113 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:43.865799 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-131d4e04-b1b1-464b-b958-fda92059f113 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:43.866521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-131d4e04-b1b1-464b-b958-fda92059f113 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:43.929346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-131d4e04-b1b1-464b-b958-fda92059f113 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:43.937203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-131d4e04-b1b1-464b-b958-fda92059f113 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092233 Jul 04 06:03:43.937766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 617/1237] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:43 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:43.962290 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2618e495-f762-42fe-bc50-99ab8e9134c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:43.963285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2618e495-f762-42fe-bc50-99ab8e9134c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:43.970276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2618e495-f762-42fe-bc50-99ab8e9134c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:43.970738 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2618e495-f762-42fe-bc50-99ab8e9134c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:43.971548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2618e495-f762-42fe-bc50-99ab8e9134c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:43.971985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2618e495-f762-42fe-bc50-99ab8e9134c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:44.002302 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2618e495-f762-42fe-bc50-99ab8e9134c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044055 Jul 04 06:03:44.002859 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 621/1238] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:44.961423 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4bdfcb4a-379e-4a43-a212-8dec07d3c6c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:44.962259 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4bdfcb4a-379e-4a43-a212-8dec07d3c6c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:44.973471 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bdfcb4a-379e-4a43-a212-8dec07d3c6c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:44.974273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bdfcb4a-379e-4a43-a212-8dec07d3c6c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:44.975636 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bdfcb4a-379e-4a43-a212-8dec07d3c6c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:44.976326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bdfcb4a-379e-4a43-a212-8dec07d3c6c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:45.014251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-17b6308a-04a4-4bf9-9902-7bda6f81b1eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:45.015283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-17b6308a-04a4-4bf9-9902-7bda6f81b1eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:45.022014 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17b6308a-04a4-4bf9-9902-7bda6f81b1eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:45.022547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17b6308a-04a4-4bf9-9902-7bda6f81b1eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:45.023421 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17b6308a-04a4-4bf9-9902-7bda6f81b1eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:45.023948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17b6308a-04a4-4bf9-9902-7bda6f81b1eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:45.027715 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:45.039517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4bdfcb4a-379e-4a43-a212-8dec07d3c6c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:45.047228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4bdfcb4a-379e-4a43-a212-8dec07d3c6c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.092461 Jul 04 06:03:45.047825 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 618/1239] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:44 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:45.054724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-17b6308a-04a4-4bf9-9902-7bda6f81b1eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Jul 04 06:03:45.055304 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 622/1240] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:46.068511 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fdaba48c-182b-477e-95a9-7974b57b479b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:46.069517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fdaba48c-182b-477e-95a9-7974b57b479b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:46.070197 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2ebf5dd4-4366-4650-b77a-6f191546a17c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:46.071733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2ebf5dd4-4366-4650-b77a-6f191546a17c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:46.082334 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdaba48c-182b-477e-95a9-7974b57b479b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:46.082666 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ebf5dd4-4366-4650-b77a-6f191546a17c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:46.083332 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ebf5dd4-4366-4650-b77a-6f191546a17c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:46.083669 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdaba48c-182b-477e-95a9-7974b57b479b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:46.084654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ebf5dd4-4366-4650-b77a-6f191546a17c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:46.085629 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ebf5dd4-4366-4650-b77a-6f191546a17c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:46.086004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdaba48c-182b-477e-95a9-7974b57b479b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:46.086949 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdaba48c-182b-477e-95a9-7974b57b479b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:46.118344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2ebf5dd4-4366-4650-b77a-6f191546a17c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054775 Jul 04 06:03:46.119112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 623/1241] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:46 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:46.155555 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fdaba48c-182b-477e-95a9-7974b57b479b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:46.166848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fdaba48c-182b-477e-95a9-7974b57b479b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.105205 Jul 04 06:03:46.167721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 619/1242] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:46 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:47.134459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-52edde46-f88d-411d-90b4-251e04fea352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:47.136000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-52edde46-f88d-411d-90b4-251e04fea352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:47.143435 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52edde46-f88d-411d-90b4-251e04fea352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:47.143887 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52edde46-f88d-411d-90b4-251e04fea352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:47.144649 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52edde46-f88d-411d-90b4-251e04fea352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:47.145080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52edde46-f88d-411d-90b4-251e04fea352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:47.177376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-52edde46-f88d-411d-90b4-251e04fea352 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049504 Jul 04 06:03:47.177971 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 624/1243] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:47.184509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f7ea3ec-6275-4542-a1e8-ad694f6a6d47 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:47.185143 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8f7ea3ec-6275-4542-a1e8-ad694f6a6d47 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:47.192149 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f7ea3ec-6275-4542-a1e8-ad694f6a6d47 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:47.192596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f7ea3ec-6275-4542-a1e8-ad694f6a6d47 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:47.193352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f7ea3ec-6275-4542-a1e8-ad694f6a6d47 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:47.193783 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f7ea3ec-6275-4542-a1e8-ad694f6a6d47 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:47.259507 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8f7ea3ec-6275-4542-a1e8-ad694f6a6d47 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:47.269579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8f7ea3ec-6275-4542-a1e8-ad694f6a6d47 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.088491 Jul 04 06:03:47.275759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 620/1244] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:47 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:03:48.190735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-605cdfcd-042c-41bf-a170-7934ea628ae1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:48.191812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-605cdfcd-042c-41bf-a170-7934ea628ae1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:48.198831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-605cdfcd-042c-41bf-a170-7934ea628ae1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:48.199292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-605cdfcd-042c-41bf-a170-7934ea628ae1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:48.200106 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-605cdfcd-042c-41bf-a170-7934ea628ae1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:48.200535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-605cdfcd-042c-41bf-a170-7934ea628ae1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:48.235536 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-605cdfcd-042c-41bf-a170-7934ea628ae1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049540 Jul 04 06:03:48.236082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 625/1245] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:48.287205 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-02ec7fd2-bb6f-497d-afae-302de7f1fbbc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:48.287977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-02ec7fd2-bb6f-497d-afae-302de7f1fbbc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:48.295197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02ec7fd2-bb6f-497d-afae-302de7f1fbbc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:48.295678 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02ec7fd2-bb6f-497d-afae-302de7f1fbbc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:48.296465 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02ec7fd2-bb6f-497d-afae-302de7f1fbbc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:48.296893 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02ec7fd2-bb6f-497d-afae-302de7f1fbbc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:48.361730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-02ec7fd2-bb6f-497d-afae-302de7f1fbbc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:48.371963 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-02ec7fd2-bb6f-497d-afae-302de7f1fbbc tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.088413 Jul 04 06:03:48.372588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 621/1246] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:48 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:49.252698 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6565b356-f6b5-4fac-8ae0-ad23c31a8ef4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:49.254171 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6565b356-f6b5-4fac-8ae0-ad23c31a8ef4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:49.264552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6565b356-f6b5-4fac-8ae0-ad23c31a8ef4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:49.265002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6565b356-f6b5-4fac-8ae0-ad23c31a8ef4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:49.265773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6565b356-f6b5-4fac-8ae0-ad23c31a8ef4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:49.266205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6565b356-f6b5-4fac-8ae0-ad23c31a8ef4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:49.296039 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6565b356-f6b5-4fac-8ae0-ad23c31a8ef4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050207 Jul 04 06:03:49.296592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 626/1247] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:49.391001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a36e37ac-d97a-4c18-a4b1-d4b2fd419c98 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:49.391674 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a36e37ac-d97a-4c18-a4b1-d4b2fd419c98 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:49.398500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a36e37ac-d97a-4c18-a4b1-d4b2fd419c98 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:49.398948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a36e37ac-d97a-4c18-a4b1-d4b2fd419c98 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:49.399750 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a36e37ac-d97a-4c18-a4b1-d4b2fd419c98 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:49.400397 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a36e37ac-d97a-4c18-a4b1-d4b2fd419c98 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:49.462082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a36e37ac-d97a-4c18-a4b1-d4b2fd419c98 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:49.471435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a36e37ac-d97a-4c18-a4b1-d4b2fd419c98 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.085112 Jul 04 06:03:49.472038 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 622/1248] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:49 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:50.311893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2bf029f1-4f6f-43e1-8913-18c1fb3bd3e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:50.312819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2bf029f1-4f6f-43e1-8913-18c1fb3bd3e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:50.319969 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bf029f1-4f6f-43e1-8913-18c1fb3bd3e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:50.320441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bf029f1-4f6f-43e1-8913-18c1fb3bd3e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:50.321205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bf029f1-4f6f-43e1-8913-18c1fb3bd3e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:50.321644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bf029f1-4f6f-43e1-8913-18c1fb3bd3e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:50.352382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2bf029f1-4f6f-43e1-8913-18c1fb3bd3e3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Jul 04 06:03:50.352939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 627/1249] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:50 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:50.488235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-881df21f-17fc-4324-88ee-9d734f06dd72 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:50.488843 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-881df21f-17fc-4324-88ee-9d734f06dd72 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:50.495550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-881df21f-17fc-4324-88ee-9d734f06dd72 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:50.495996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-881df21f-17fc-4324-88ee-9d734f06dd72 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:50.496965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-881df21f-17fc-4324-88ee-9d734f06dd72 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:50.497443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-881df21f-17fc-4324-88ee-9d734f06dd72 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:50.573776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-881df21f-17fc-4324-88ee-9d734f06dd72 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:50.581608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-881df21f-17fc-4324-88ee-9d734f06dd72 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.097239 Jul 04 06:03:50.582173 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 623/1250] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:50 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:51.368621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ab70514b-25fb-4967-a0a3-7b2a4d2848d0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:51.370112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ab70514b-25fb-4967-a0a3-7b2a4d2848d0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:51.381106 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab70514b-25fb-4967-a0a3-7b2a4d2848d0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:51.381768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab70514b-25fb-4967-a0a3-7b2a4d2848d0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:51.383069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab70514b-25fb-4967-a0a3-7b2a4d2848d0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:51.383882 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab70514b-25fb-4967-a0a3-7b2a4d2848d0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:51.415486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ab70514b-25fb-4967-a0a3-7b2a4d2848d0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053495 Jul 04 06:03:51.416022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 628/1251] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:51 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:51.598052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c05d413-18ee-4704-a5ce-cabfe8418f44 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:51.598665 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9c05d413-18ee-4704-a5ce-cabfe8418f44 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:51.605237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c05d413-18ee-4704-a5ce-cabfe8418f44 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:51.605683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c05d413-18ee-4704-a5ce-cabfe8418f44 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:51.606572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c05d413-18ee-4704-a5ce-cabfe8418f44 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:51.607000 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c05d413-18ee-4704-a5ce-cabfe8418f44 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:51.667672 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9c05d413-18ee-4704-a5ce-cabfe8418f44 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:51.675190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9c05d413-18ee-4704-a5ce-cabfe8418f44 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.081130 Jul 04 06:03:51.675779 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 624/1252] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:51 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:52.431425 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-372a779c-dd44-47b5-b79b-13316c820ce3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:52.433006 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-372a779c-dd44-47b5-b79b-13316c820ce3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:52.436562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=58 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:52.442326 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-372a779c-dd44-47b5-b79b-13316c820ce3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:52.442670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-372a779c-dd44-47b5-b79b-13316c820ce3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:52.443440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-372a779c-dd44-47b5-b79b-13316c820ce3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:52.443872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-372a779c-dd44-47b5-b79b-13316c820ce3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:52.473102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-372a779c-dd44-47b5-b79b-13316c820ce3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048383 Jul 04 06:03:52.473646 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 629/1253] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:52 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:52.702337 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-60e3a0ad-8883-48bd-a734-e1a0ffa8c27c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:52.703178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-60e3a0ad-8883-48bd-a734-e1a0ffa8c27c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:52.714041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60e3a0ad-8883-48bd-a734-e1a0ffa8c27c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:52.714802 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60e3a0ad-8883-48bd-a734-e1a0ffa8c27c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:52.716134 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60e3a0ad-8883-48bd-a734-e1a0ffa8c27c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:52.716871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60e3a0ad-8883-48bd-a734-e1a0ffa8c27c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:52.778174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-60e3a0ad-8883-48bd-a734-e1a0ffa8c27c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:52.786152 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-60e3a0ad-8883-48bd-a734-e1a0ffa8c27c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090465 Jul 04 06:03:52.786714 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 625/1254] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:52 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:53.489174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1848952e-bdc9-4664-9585-e7bd2de89421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:53.490653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1848952e-bdc9-4664-9585-e7bd2de89421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:53.500597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1848952e-bdc9-4664-9585-e7bd2de89421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:53.501054 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1848952e-bdc9-4664-9585-e7bd2de89421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:53.501830 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1848952e-bdc9-4664-9585-e7bd2de89421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:53.502272 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1848952e-bdc9-4664-9585-e7bd2de89421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:53.532393 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1848952e-bdc9-4664-9585-e7bd2de89421 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049912 Jul 04 06:03:53.532963 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 630/1255] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:53 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:53.804113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-179cbe77-7da8-49b9-8cbb-9938587d4360 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:53.804823 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-179cbe77-7da8-49b9-8cbb-9938587d4360 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:53.814330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-179cbe77-7da8-49b9-8cbb-9938587d4360 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:53.814924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-179cbe77-7da8-49b9-8cbb-9938587d4360 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:53.815996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-179cbe77-7da8-49b9-8cbb-9938587d4360 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:53.816573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-179cbe77-7da8-49b9-8cbb-9938587d4360 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:53.886006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-179cbe77-7da8-49b9-8cbb-9938587d4360 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:53.895290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-179cbe77-7da8-49b9-8cbb-9938587d4360 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.096368 Jul 04 06:03:53.895856 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 626/1256] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:53 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:54.544305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8c56daf7-2b1e-4465-a016-414c92f29e44 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:54.545280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8c56daf7-2b1e-4465-a016-414c92f29e44 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:54.552264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c56daf7-2b1e-4465-a016-414c92f29e44 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:54.552713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c56daf7-2b1e-4465-a016-414c92f29e44 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:54.553473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c56daf7-2b1e-4465-a016-414c92f29e44 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:54.553906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c56daf7-2b1e-4465-a016-414c92f29e44 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:54.583150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8c56daf7-2b1e-4465-a016-414c92f29e44 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042910 Jul 04 06:03:54.583733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 631/1257] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:54.913789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9874dd95-4375-40f6-9c64-798f0866902d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:54.914408 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9874dd95-4375-40f6-9c64-798f0866902d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:54.922094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9874dd95-4375-40f6-9c64-798f0866902d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:54.922761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9874dd95-4375-40f6-9c64-798f0866902d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:54.923648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9874dd95-4375-40f6-9c64-798f0866902d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:54.924127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9874dd95-4375-40f6-9c64-798f0866902d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:54.991721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9874dd95-4375-40f6-9c64-798f0866902d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:54.999601 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9874dd95-4375-40f6-9c64-798f0866902d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090237 Jul 04 06:03:55.000159 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 627/1258] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:54 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:55.599668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0572550e-3a62-4464-9a14-8a4df46c5166 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:55.601160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0572550e-3a62-4464-9a14-8a4df46c5166 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:55.612351 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0572550e-3a62-4464-9a14-8a4df46c5166 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:55.613080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0572550e-3a62-4464-9a14-8a4df46c5166 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:55.614327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0572550e-3a62-4464-9a14-8a4df46c5166 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:55.615038 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0572550e-3a62-4464-9a14-8a4df46c5166 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:55.648198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0572550e-3a62-4464-9a14-8a4df46c5166 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055616 Jul 04 06:03:55.648748 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 632/1259] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:56.019109 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ea0581e-7812-4679-a9a5-ed2f56a5c491 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:56.019760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1ea0581e-7812-4679-a9a5-ed2f56a5c491 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:56.026642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ea0581e-7812-4679-a9a5-ed2f56a5c491 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:56.027102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ea0581e-7812-4679-a9a5-ed2f56a5c491 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:56.027898 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ea0581e-7812-4679-a9a5-ed2f56a5c491 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:56.028291 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ea0581e-7812-4679-a9a5-ed2f56a5c491 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:56.140211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ea0581e-7812-4679-a9a5-ed2f56a5c491 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:56.148515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ea0581e-7812-4679-a9a5-ed2f56a5c491 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.134254 Jul 04 06:03:56.149279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 628/1260] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:56 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:56.664226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15f6aa9e-4d9d-46d7-a433-7cb2fe0a13e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:56.665622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-15f6aa9e-4d9d-46d7-a433-7cb2fe0a13e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:56.674757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15f6aa9e-4d9d-46d7-a433-7cb2fe0a13e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:56.675201 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15f6aa9e-4d9d-46d7-a433-7cb2fe0a13e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:56.675983 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15f6aa9e-4d9d-46d7-a433-7cb2fe0a13e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:56.676410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15f6aa9e-4d9d-46d7-a433-7cb2fe0a13e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:56.706015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-15f6aa9e-4d9d-46d7-a433-7cb2fe0a13e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048693 Jul 04 06:03:56.706616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 633/1261] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:56 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:57.169477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e47521f-3d85-4324-bdaa-f23acf4839b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:57.170444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9e47521f-3d85-4324-bdaa-f23acf4839b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:57.181542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e47521f-3d85-4324-bdaa-f23acf4839b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:57.182284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e47521f-3d85-4324-bdaa-f23acf4839b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:57.183983 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e47521f-3d85-4324-bdaa-f23acf4839b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:57.184901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e47521f-3d85-4324-bdaa-f23acf4839b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:57.248757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9e47521f-3d85-4324-bdaa-f23acf4839b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:57.252369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:57.257241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e47521f-3d85-4324-bdaa-f23acf4839b8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.094466 Jul 04 06:03:57.257850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 629/1262] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:57 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:57.722485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4cdc9adf-d38d-41e1-8313-7aaf396ef79c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:57.723918 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4cdc9adf-d38d-41e1-8313-7aaf396ef79c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:57.733102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cdc9adf-d38d-41e1-8313-7aaf396ef79c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:57.733759 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cdc9adf-d38d-41e1-8313-7aaf396ef79c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:57.734872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cdc9adf-d38d-41e1-8313-7aaf396ef79c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:57.735506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cdc9adf-d38d-41e1-8313-7aaf396ef79c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:57.772055 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4cdc9adf-d38d-41e1-8313-7aaf396ef79c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056566 Jul 04 06:03:57.772531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 634/1263] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:57 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:58.274322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-65a1878e-50f5-41e5-b5bf-0ed689857fbf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:58.274922 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-65a1878e-50f5-41e5-b5bf-0ed689857fbf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:58.282213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65a1878e-50f5-41e5-b5bf-0ed689857fbf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:58.282685 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65a1878e-50f5-41e5-b5bf-0ed689857fbf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:58.283483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65a1878e-50f5-41e5-b5bf-0ed689857fbf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:58.283917 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65a1878e-50f5-41e5-b5bf-0ed689857fbf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:58.343962 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-65a1878e-50f5-41e5-b5bf-0ed689857fbf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:58.352846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-65a1878e-50f5-41e5-b5bf-0ed689857fbf tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.082696 Jul 04 06:03:58.353429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 630/1264] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:58 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:58.788559 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c42e833d-4f4d-4ea6-bfe6-b7faa44765b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:58.789918 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c42e833d-4f4d-4ea6-bfe6-b7faa44765b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:58.801493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c42e833d-4f4d-4ea6-bfe6-b7faa44765b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:58.801934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c42e833d-4f4d-4ea6-bfe6-b7faa44765b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:58.802703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c42e833d-4f4d-4ea6-bfe6-b7faa44765b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:58.803129 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c42e833d-4f4d-4ea6-bfe6-b7faa44765b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:58.832891 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c42e833d-4f4d-4ea6-bfe6-b7faa44765b4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051158 Jul 04 06:03:58.833441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 635/1265] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:03:59.370102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9a35a3f2-8387-4e72-9601-c434a9052096 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:59.370719 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9a35a3f2-8387-4e72-9601-c434a9052096 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:59.373058 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=56 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:59.378636 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a35a3f2-8387-4e72-9601-c434a9052096 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:59.379074 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a35a3f2-8387-4e72-9601-c434a9052096 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:59.379870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a35a3f2-8387-4e72-9601-c434a9052096 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:59.380311 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a35a3f2-8387-4e72-9601-c434a9052096 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:59.446755 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a35a3f2-8387-4e72-9601-c434a9052096 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:03:59.457533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9a35a3f2-8387-4e72-9601-c434a9052096 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091392 Jul 04 06:03:59.458094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 631/1266] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:03:59 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:03:59.847934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4c2458df-c1b8-4587-81c4-5802c012f502 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:03:59.848871 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4c2458df-c1b8-4587-81c4-5802c012f502 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:03:59.855943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c2458df-c1b8-4587-81c4-5802c012f502 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:59.856392 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c2458df-c1b8-4587-81c4-5802c012f502 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:59.857138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c2458df-c1b8-4587-81c4-5802c012f502 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:03:59.857604 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c2458df-c1b8-4587-81c4-5802c012f502 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:03:59.887972 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4c2458df-c1b8-4587-81c4-5802c012f502 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Jul 04 06:03:59.888555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 636/1267] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:03:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:00.478197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1f83403d-4aa4-4708-906e-18a081a7a17b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:00.479209 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1f83403d-4aa4-4708-906e-18a081a7a17b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:00.489444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f83403d-4aa4-4708-906e-18a081a7a17b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:00.489875 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f83403d-4aa4-4708-906e-18a081a7a17b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:00.490649 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f83403d-4aa4-4708-906e-18a081a7a17b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:00.491086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f83403d-4aa4-4708-906e-18a081a7a17b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:00.552909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1f83403d-4aa4-4708-906e-18a081a7a17b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:00.563060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1f83403d-4aa4-4708-906e-18a081a7a17b tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091316 Jul 04 06:04:00.563931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 632/1268] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:00 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:00.906535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-47f8fd43-fb3c-4988-8313-36fde89847ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:00.907945 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-47f8fd43-fb3c-4988-8313-36fde89847ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:00.915556 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47f8fd43-fb3c-4988-8313-36fde89847ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:00.916003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47f8fd43-fb3c-4988-8313-36fde89847ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:00.916768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47f8fd43-fb3c-4988-8313-36fde89847ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:00.917211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47f8fd43-fb3c-4988-8313-36fde89847ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:00.946844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-47f8fd43-fb3c-4988-8313-36fde89847ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047611 Jul 04 06:04:00.947437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 637/1269] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:00 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:01.584772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-237da165-1e64-4195-ae2d-522b2b7c630d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:01.585773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-237da165-1e64-4195-ae2d-522b2b7c630d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:01.596743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-237da165-1e64-4195-ae2d-522b2b7c630d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:01.597337 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-237da165-1e64-4195-ae2d-522b2b7c630d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:01.598105 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-237da165-1e64-4195-ae2d-522b2b7c630d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:01.598535 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-237da165-1e64-4195-ae2d-522b2b7c630d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:01.661977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-237da165-1e64-4195-ae2d-522b2b7c630d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:01.670168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-237da165-1e64-4195-ae2d-522b2b7c630d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091786 Jul 04 06:04:01.670664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 633/1270] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:01 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:01.963681 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-981b7602-492d-445d-92a3-508c4270d414 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:01.965104 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-981b7602-492d-445d-92a3-508c4270d414 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:01.976204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-981b7602-492d-445d-92a3-508c4270d414 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:01.976943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-981b7602-492d-445d-92a3-508c4270d414 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:01.978194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-981b7602-492d-445d-92a3-508c4270d414 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:01.978919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-981b7602-492d-445d-92a3-508c4270d414 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:02.006880 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:02.011426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-981b7602-492d-445d-92a3-508c4270d414 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054777 Jul 04 06:04:02.011978 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 638/1271] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:01 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:02.691131 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8217f74-3ceb-450c-a13f-81591882931a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:02.692214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8217f74-3ceb-450c-a13f-81591882931a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:02.703186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8217f74-3ceb-450c-a13f-81591882931a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:02.703990 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8217f74-3ceb-450c-a13f-81591882931a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:02.705277 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8217f74-3ceb-450c-a13f-81591882931a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:02.706030 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8217f74-3ceb-450c-a13f-81591882931a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:02.772803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8217f74-3ceb-450c-a13f-81591882931a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:02.780813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8217f74-3ceb-450c-a13f-81591882931a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.096270 Jul 04 06:04:02.781384 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 634/1272] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:02 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:03.023046 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-88b52126-59d7-43dd-a5e5-b37bd9512374 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:03.023918 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-88b52126-59d7-43dd-a5e5-b37bd9512374 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:03.031016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88b52126-59d7-43dd-a5e5-b37bd9512374 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:03.031500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88b52126-59d7-43dd-a5e5-b37bd9512374 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:03.032316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88b52126-59d7-43dd-a5e5-b37bd9512374 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:03.032758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88b52126-59d7-43dd-a5e5-b37bd9512374 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:03.061703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-88b52126-59d7-43dd-a5e5-b37bd9512374 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043144 Jul 04 06:04:03.062249 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 639/1273] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:03.801900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-91cbfdad-def8-4fb3-b341-3dc87b7b8489 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:03.802770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-91cbfdad-def8-4fb3-b341-3dc87b7b8489 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:03.814809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91cbfdad-def8-4fb3-b341-3dc87b7b8489 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:03.816021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91cbfdad-def8-4fb3-b341-3dc87b7b8489 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:03.816851 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91cbfdad-def8-4fb3-b341-3dc87b7b8489 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:03.817288 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91cbfdad-def8-4fb3-b341-3dc87b7b8489 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:03.881516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-91cbfdad-def8-4fb3-b341-3dc87b7b8489 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:03.893351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-91cbfdad-def8-4fb3-b341-3dc87b7b8489 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.097894 Jul 04 06:04:03.894238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 635/1274] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:03 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:04.077916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3fc2deb3-f710-476b-90d3-c00caebd6dba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:04.079241 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3fc2deb3-f710-476b-90d3-c00caebd6dba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:04.087016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fc2deb3-f710-476b-90d3-c00caebd6dba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:04.087512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fc2deb3-f710-476b-90d3-c00caebd6dba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:04.088312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fc2deb3-f710-476b-90d3-c00caebd6dba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:04.088751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fc2deb3-f710-476b-90d3-c00caebd6dba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:04.118522 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3fc2deb3-f710-476b-90d3-c00caebd6dba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047548 Jul 04 06:04:04.119085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 640/1275] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:04.920363 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8114ccef-62f6-44c9-b546-18905be067fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:04.921228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8114ccef-62f6-44c9-b546-18905be067fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:04.929961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8114ccef-62f6-44c9-b546-18905be067fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:04.930418 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8114ccef-62f6-44c9-b546-18905be067fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:04.931190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8114ccef-62f6-44c9-b546-18905be067fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:04.931663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8114ccef-62f6-44c9-b546-18905be067fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:05.002390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8114ccef-62f6-44c9-b546-18905be067fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:05.010147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8114ccef-62f6-44c9-b546-18905be067fe tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.096548 Jul 04 06:04:05.010715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 636/1276] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:04 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:05.134338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-82f71123-7bde-45bf-a84f-8a6343d13c55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:05.135865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-82f71123-7bde-45bf-a84f-8a6343d13c55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:05.146850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82f71123-7bde-45bf-a84f-8a6343d13c55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:05.147663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82f71123-7bde-45bf-a84f-8a6343d13c55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:05.148966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82f71123-7bde-45bf-a84f-8a6343d13c55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:05.149676 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82f71123-7bde-45bf-a84f-8a6343d13c55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:05.183784 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-82f71123-7bde-45bf-a84f-8a6343d13c55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056175 Jul 04 06:04:05.184255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 641/1277] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:05 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:05.721267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:04:05.721472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:04:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:04:06.032056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4f7887b2-4a77-4f71-9302-0c9a3693dfd0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:06.032943 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4f7887b2-4a77-4f71-9302-0c9a3693dfd0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:06.040729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f7887b2-4a77-4f71-9302-0c9a3693dfd0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:06.041215 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f7887b2-4a77-4f71-9302-0c9a3693dfd0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:06.042010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f7887b2-4a77-4f71-9302-0c9a3693dfd0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:06.042443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f7887b2-4a77-4f71-9302-0c9a3693dfd0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:06.103659 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4f7887b2-4a77-4f71-9302-0c9a3693dfd0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:06.111606 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4f7887b2-4a77-4f71-9302-0c9a3693dfd0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.086333 Jul 04 06:04:06.112206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 637/1278] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:06 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:06.198705 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0ad8f1ff-9b03-4d3a-8a83-6224dde79887 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:06.200178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0ad8f1ff-9b03-4d3a-8a83-6224dde79887 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:06.209238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ad8f1ff-9b03-4d3a-8a83-6224dde79887 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:06.209686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ad8f1ff-9b03-4d3a-8a83-6224dde79887 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:06.210452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ad8f1ff-9b03-4d3a-8a83-6224dde79887 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:06.210881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ad8f1ff-9b03-4d3a-8a83-6224dde79887 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:06.240465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0ad8f1ff-9b03-4d3a-8a83-6224dde79887 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047865 Jul 04 06:04:06.241012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 642/1279] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:07.137686 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef8ed2a4-f493-4d31-952a-b41513ecc04e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:07.138686 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef8ed2a4-f493-4d31-952a-b41513ecc04e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:07.147551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef8ed2a4-f493-4d31-952a-b41513ecc04e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:07.148002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef8ed2a4-f493-4d31-952a-b41513ecc04e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:07.148774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef8ed2a4-f493-4d31-952a-b41513ecc04e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:07.149203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef8ed2a4-f493-4d31-952a-b41513ecc04e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:07.211201 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef8ed2a4-f493-4d31-952a-b41513ecc04e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:07.218930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef8ed2a4-f493-4d31-952a-b41513ecc04e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.087914 Jul 04 06:04:07.219515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 638/1280] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:07 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:07.252227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1d08a1ff-929c-414a-b030-fe3ed7003719 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:07.253145 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1d08a1ff-929c-414a-b030-fe3ed7003719 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:07.259922 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d08a1ff-929c-414a-b030-fe3ed7003719 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:07.260367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d08a1ff-929c-414a-b030-fe3ed7003719 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:07.261126 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d08a1ff-929c-414a-b030-fe3ed7003719 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:07.261558 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d08a1ff-929c-414a-b030-fe3ed7003719 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:07.290819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1d08a1ff-929c-414a-b030-fe3ed7003719 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042551 Jul 04 06:04:07.291386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 643/1281] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:08.238863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3a9227d0-3a3e-416b-be23-3ed31c10ca23 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:08.239585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3a9227d0-3a3e-416b-be23-3ed31c10ca23 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:08.249500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a9227d0-3a3e-416b-be23-3ed31c10ca23 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:08.249967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a9227d0-3a3e-416b-be23-3ed31c10ca23 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:08.251114 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a9227d0-3a3e-416b-be23-3ed31c10ca23 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:08.251709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a9227d0-3a3e-416b-be23-3ed31c10ca23 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:08.302216 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bea9aeaa-96cf-4688-9729-9ee662aa5594 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:08.303177 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bea9aeaa-96cf-4688-9729-9ee662aa5594 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:08.310262 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bea9aeaa-96cf-4688-9729-9ee662aa5594 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:08.310711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bea9aeaa-96cf-4688-9729-9ee662aa5594 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:08.311522 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bea9aeaa-96cf-4688-9729-9ee662aa5594 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:08.311958 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bea9aeaa-96cf-4688-9729-9ee662aa5594 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:08.318777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3a9227d0-3a3e-416b-be23-3ed31c10ca23 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:08.326544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3a9227d0-3a3e-416b-be23-3ed31c10ca23 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.093650 Jul 04 06:04:08.327123 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 639/1282] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:08 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:08.341855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bea9aeaa-96cf-4688-9729-9ee662aa5594 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043604 Jul 04 06:04:08.342412 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 644/1283] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:08 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:09.347225 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9ee918e4-aeb4-4943-82b8-7f48acbf51c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:09.348178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9ee918e4-aeb4-4943-82b8-7f48acbf51c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:09.357320 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ed963918-0927-430a-98c7-35f97d63161d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:09.358888 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ed963918-0927-430a-98c7-35f97d63161d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:09.359198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ee918e4-aeb4-4943-82b8-7f48acbf51c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:09.359974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ee918e4-aeb4-4943-82b8-7f48acbf51c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:09.361251 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ee918e4-aeb4-4943-82b8-7f48acbf51c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:09.361978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ee918e4-aeb4-4943-82b8-7f48acbf51c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:09.367349 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed963918-0927-430a-98c7-35f97d63161d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:09.367859 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed963918-0927-430a-98c7-35f97d63161d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:09.368617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed963918-0927-430a-98c7-35f97d63161d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:09.369046 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed963918-0927-430a-98c7-35f97d63161d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:09.398832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ed963918-0927-430a-98c7-35f97d63161d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048055 Jul 04 06:04:09.399432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 645/1284] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:09.422835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9ee918e4-aeb4-4943-82b8-7f48acbf51c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:09.430493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9ee918e4-aeb4-4943-82b8-7f48acbf51c7 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.089628 Jul 04 06:04:09.431049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 640/1285] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:09 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:10.414537 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-821ed104-8fb3-475e-8260-902a799b8c21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:10.416068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-821ed104-8fb3-475e-8260-902a799b8c21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:10.427326 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-821ed104-8fb3-475e-8260-902a799b8c21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:10.428132 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-821ed104-8fb3-475e-8260-902a799b8c21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:10.429402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-821ed104-8fb3-475e-8260-902a799b8c21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:10.430133 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-821ed104-8fb3-475e-8260-902a799b8c21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:10.448905 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-afd8384f-4644-4ac1-a5d5-b6eae15a6286 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:10.449420 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-afd8384f-4644-4ac1-a5d5-b6eae15a6286 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:10.456155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afd8384f-4644-4ac1-a5d5-b6eae15a6286 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:10.456726 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afd8384f-4644-4ac1-a5d5-b6eae15a6286 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:10.457574 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afd8384f-4644-4ac1-a5d5-b6eae15a6286 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:10.458020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afd8384f-4644-4ac1-a5d5-b6eae15a6286 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:10.468528 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-821ed104-8fb3-475e-8260-902a799b8c21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060767 Jul 04 06:04:10.469099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 646/1286] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:10 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:10.530723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-afd8384f-4644-4ac1-a5d5-b6eae15a6286 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:10.540778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-afd8384f-4644-4ac1-a5d5-b6eae15a6286 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.094008 Jul 04 06:04:10.552147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 641/1287] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:10 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:11.484849 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2d37dd43-bf6b-456f-93b0-53a9808eb873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:11.486335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2d37dd43-bf6b-456f-93b0-53a9808eb873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:11.493870 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d37dd43-bf6b-456f-93b0-53a9808eb873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:11.494339 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d37dd43-bf6b-456f-93b0-53a9808eb873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:11.495102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d37dd43-bf6b-456f-93b0-53a9808eb873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:11.495569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d37dd43-bf6b-456f-93b0-53a9808eb873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:11.525872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2d37dd43-bf6b-456f-93b0-53a9808eb873 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047730 Jul 04 06:04:11.526470 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 647/1288] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:11 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:11.559042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e9a962e-374b-4a6d-bdb1-d6b9d28ef817 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:11.559702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9e9a962e-374b-4a6d-bdb1-d6b9d28ef817 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:11.567695 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9a962e-374b-4a6d-bdb1-d6b9d28ef817 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:11.568509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9a962e-374b-4a6d-bdb1-d6b9d28ef817 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:11.569869 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9a962e-374b-4a6d-bdb1-d6b9d28ef817 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:11.570353 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9a962e-374b-4a6d-bdb1-d6b9d28ef817 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:11.636813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9e9a962e-374b-4a6d-bdb1-d6b9d28ef817 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:11.645099 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e9a962e-374b-4a6d-bdb1-d6b9d28ef817 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.089864 Jul 04 06:04:11.645634 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 642/1289] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:11 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:12.538489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-83cbec1f-cbcb-4017-853a-0649da33870b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:12.539450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-83cbec1f-cbcb-4017-853a-0649da33870b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:12.546518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83cbec1f-cbcb-4017-853a-0649da33870b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:12.546961 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83cbec1f-cbcb-4017-853a-0649da33870b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:12.547744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83cbec1f-cbcb-4017-853a-0649da33870b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:12.548173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83cbec1f-cbcb-4017-853a-0649da33870b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:12.578909 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-83cbec1f-cbcb-4017-853a-0649da33870b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044430 Jul 04 06:04:12.579513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 648/1290] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:12 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:12.662150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d3a3249-8855-4697-933b-9b960da42024 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:12.662945 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d3a3249-8855-4697-933b-9b960da42024 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:12.669823 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d3a3249-8855-4697-933b-9b960da42024 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:12.670273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d3a3249-8855-4697-933b-9b960da42024 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:12.671049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d3a3249-8855-4697-933b-9b960da42024 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:12.671598 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d3a3249-8855-4697-933b-9b960da42024 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:12.735972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d3a3249-8855-4697-933b-9b960da42024 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:12.743484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d3a3249-8855-4697-933b-9b960da42024 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.085468 Jul 04 06:04:12.744422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 643/1291] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:12 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:13.595508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ef46dddf-231b-454d-ac4a-c7350ed93141 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:13.597006 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ef46dddf-231b-454d-ac4a-c7350ed93141 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:13.604430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef46dddf-231b-454d-ac4a-c7350ed93141 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:13.604869 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef46dddf-231b-454d-ac4a-c7350ed93141 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:13.605621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef46dddf-231b-454d-ac4a-c7350ed93141 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:13.606083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef46dddf-231b-454d-ac4a-c7350ed93141 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:13.642282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ef46dddf-231b-454d-ac4a-c7350ed93141 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053703 Jul 04 06:04:13.642760 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 649/1292] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:13 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:13.760266 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b4747e54-3d54-49c6-ae5e-e20e7e169500 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:13.760981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b4747e54-3d54-49c6-ae5e-e20e7e169500 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:13.767567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4747e54-3d54-49c6-ae5e-e20e7e169500 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:13.768090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4747e54-3d54-49c6-ae5e-e20e7e169500 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:13.768954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4747e54-3d54-49c6-ae5e-e20e7e169500 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:13.769525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4747e54-3d54-49c6-ae5e-e20e7e169500 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:13.844056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b4747e54-3d54-49c6-ae5e-e20e7e169500 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:13.851775 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b4747e54-3d54-49c6-ae5e-e20e7e169500 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.095468 Jul 04 06:04:13.852666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 644/1293] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:13 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:14.658758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-36db775e-f696-4dfa-9247-5708c2a1da3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:14.660295 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-36db775e-f696-4dfa-9247-5708c2a1da3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:14.671229 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36db775e-f696-4dfa-9247-5708c2a1da3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:14.672023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36db775e-f696-4dfa-9247-5708c2a1da3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:14.673284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36db775e-f696-4dfa-9247-5708c2a1da3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:14.674000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36db775e-f696-4dfa-9247-5708c2a1da3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:14.704652 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-36db775e-f696-4dfa-9247-5708c2a1da3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053009 Jul 04 06:04:14.705224 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 650/1294] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:14 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:14.872549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce47d9ab-b75a-4cb4-9987-c11d1d2051c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:14.873702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ce47d9ab-b75a-4cb4-9987-c11d1d2051c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:14.882543 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce47d9ab-b75a-4cb4-9987-c11d1d2051c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:14.882996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce47d9ab-b75a-4cb4-9987-c11d1d2051c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:14.883811 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce47d9ab-b75a-4cb4-9987-c11d1d2051c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:14.884253 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce47d9ab-b75a-4cb4-9987-c11d1d2051c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:14.954290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce47d9ab-b75a-4cb4-9987-c11d1d2051c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:14.961983 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce47d9ab-b75a-4cb4-9987-c11d1d2051c3 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.096070 Jul 04 06:04:14.962548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 645/1295] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:14 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:15.719944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-580811ae-e88b-4b2f-90de-13bf94ff243b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:15.721445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-580811ae-e88b-4b2f-90de-13bf94ff243b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:15.728982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-580811ae-e88b-4b2f-90de-13bf94ff243b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:15.729433 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-580811ae-e88b-4b2f-90de-13bf94ff243b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:15.730201 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-580811ae-e88b-4b2f-90de-13bf94ff243b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:15.730637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-580811ae-e88b-4b2f-90de-13bf94ff243b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:15.766121 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-580811ae-e88b-4b2f-90de-13bf94ff243b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052501 Jul 04 06:04:15.766815 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 651/1296] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:15.978034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cf0d8cfe-0887-4866-8ef4-4cbad8dd19d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:15.978658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cf0d8cfe-0887-4866-8ef4-4cbad8dd19d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:15.988239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf0d8cfe-0887-4866-8ef4-4cbad8dd19d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:15.988717 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf0d8cfe-0887-4866-8ef4-4cbad8dd19d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:15.989490 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf0d8cfe-0887-4866-8ef4-4cbad8dd19d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:15.989947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf0d8cfe-0887-4866-8ef4-4cbad8dd19d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:16.009829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:16.052903 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cf0d8cfe-0887-4866-8ef4-4cbad8dd19d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:16.060569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cf0d8cfe-0887-4866-8ef4-4cbad8dd19d2 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.086462 Jul 04 06:04:16.061415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 646/1297] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:15 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:16.784480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0f443955-29a3-43d7-9a41-1190e1aa6312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:16.785913 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0f443955-29a3-43d7-9a41-1190e1aa6312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:16.797233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f443955-29a3-43d7-9a41-1190e1aa6312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:16.798073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f443955-29a3-43d7-9a41-1190e1aa6312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:16.799645 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f443955-29a3-43d7-9a41-1190e1aa6312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:16.800431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f443955-29a3-43d7-9a41-1190e1aa6312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:16.830930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0f443955-29a3-43d7-9a41-1190e1aa6312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053594 Jul 04 06:04:16.831547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 652/1298] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:16.958234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:04:16.958496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:04:17.081279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a9b7ff9-129c-4530-9c08-7aae2c31af0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:17.082250 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1a9b7ff9-129c-4530-9c08-7aae2c31af0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:17.093283 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a9b7ff9-129c-4530-9c08-7aae2c31af0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:17.093973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a9b7ff9-129c-4530-9c08-7aae2c31af0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:17.095314 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a9b7ff9-129c-4530-9c08-7aae2c31af0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:17.096090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a9b7ff9-129c-4530-9c08-7aae2c31af0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:17.160870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a9b7ff9-129c-4530-9c08-7aae2c31af0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:17.168830 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a9b7ff9-129c-4530-9c08-7aae2c31af0e tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.094091 Jul 04 06:04:17.169393 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 647/1299] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:17 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:17.846699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6944477b-efd5-4a78-83ed-ec398a5e1695 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:17.848076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6944477b-efd5-4a78-83ed-ec398a5e1695 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:17.854833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6944477b-efd5-4a78-83ed-ec398a5e1695 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:17.855316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6944477b-efd5-4a78-83ed-ec398a5e1695 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:17.856111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6944477b-efd5-4a78-83ed-ec398a5e1695 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:17.856549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6944477b-efd5-4a78-83ed-ec398a5e1695 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:17.886015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6944477b-efd5-4a78-83ed-ec398a5e1695 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046377 Jul 04 06:04:17.886586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 653/1300] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:18.194133 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe6db6a5-fbde-49e1-82a0-abf6cf4d52e4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:18.195187 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe6db6a5-fbde-49e1-82a0-abf6cf4d52e4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:18.207523 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe6db6a5-fbde-49e1-82a0-abf6cf4d52e4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:18.208044 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe6db6a5-fbde-49e1-82a0-abf6cf4d52e4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:18.208762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe6db6a5-fbde-49e1-82a0-abf6cf4d52e4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:18.209200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe6db6a5-fbde-49e1-82a0-abf6cf4d52e4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:18.270602 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe6db6a5-fbde-49e1-82a0-abf6cf4d52e4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:18.278497 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe6db6a5-fbde-49e1-82a0-abf6cf4d52e4 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090607 Jul 04 06:04:18.279073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 648/1301] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:18 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:18.898256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3c876fc7-8be2-4d1c-b0e0-5a8341f56a00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:18.899187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3c876fc7-8be2-4d1c-b0e0-5a8341f56a00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:18.906731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c876fc7-8be2-4d1c-b0e0-5a8341f56a00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:18.907179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c876fc7-8be2-4d1c-b0e0-5a8341f56a00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:18.907988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c876fc7-8be2-4d1c-b0e0-5a8341f56a00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:18.908426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c876fc7-8be2-4d1c-b0e0-5a8341f56a00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:18.938947 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3c876fc7-8be2-4d1c-b0e0-5a8341f56a00 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044728 Jul 04 06:04:18.939538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 654/1302] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:19.299833 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-12e0082a-b744-4963-9e7e-0df067672e7a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:19.300871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-12e0082a-b744-4963-9e7e-0df067672e7a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:19.312230 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12e0082a-b744-4963-9e7e-0df067672e7a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:19.312984 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12e0082a-b744-4963-9e7e-0df067672e7a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:19.314280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12e0082a-b744-4963-9e7e-0df067672e7a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:19.315030 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12e0082a-b744-4963-9e7e-0df067672e7a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:19.377409 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-12e0082a-b744-4963-9e7e-0df067672e7a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:19.385015 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-12e0082a-b744-4963-9e7e-0df067672e7a tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.091690 Jul 04 06:04:19.385572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 649/1303] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:19 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:19.956933 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-05b0d755-d23b-4019-916b-c717976b7fb5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:19.958609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-05b0d755-d23b-4019-916b-c717976b7fb5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:19.969572 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05b0d755-d23b-4019-916b-c717976b7fb5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:19.970294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05b0d755-d23b-4019-916b-c717976b7fb5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:19.971591 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05b0d755-d23b-4019-916b-c717976b7fb5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:19.972277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05b0d755-d23b-4019-916b-c717976b7fb5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:19.994362 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:20.007712 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-05b0d755-d23b-4019-916b-c717976b7fb5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057784 Jul 04 06:04:20.008293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 655/1304] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:20.406824 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8db1d0ff-b0d5-405f-9b29-8a803d8d451c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:20.407964 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8db1d0ff-b0d5-405f-9b29-8a803d8d451c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:20.415870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8db1d0ff-b0d5-405f-9b29-8a803d8d451c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:20.416317 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8db1d0ff-b0d5-405f-9b29-8a803d8d451c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:20.417075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8db1d0ff-b0d5-405f-9b29-8a803d8d451c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:20.417500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8db1d0ff-b0d5-405f-9b29-8a803d8d451c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:20.480073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8db1d0ff-b0d5-405f-9b29-8a803d8d451c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:20.490551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8db1d0ff-b0d5-405f-9b29-8a803d8d451c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090973 Jul 04 06:04:20.491124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 650/1305] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:20 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:21.025562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-31190d34-71b0-4fda-92ea-0010baeab80d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:21.027077 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-31190d34-71b0-4fda-92ea-0010baeab80d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:21.038068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31190d34-71b0-4fda-92ea-0010baeab80d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:21.038509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31190d34-71b0-4fda-92ea-0010baeab80d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:21.039270 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31190d34-71b0-4fda-92ea-0010baeab80d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:21.039714 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31190d34-71b0-4fda-92ea-0010baeab80d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:21.070767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-31190d34-71b0-4fda-92ea-0010baeab80d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052045 Jul 04 06:04:21.071358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 656/1306] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:21.510095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f4d4e888-6458-429e-8cec-087f8b05a249 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:21.510744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f4d4e888-6458-429e-8cec-087f8b05a249 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:21.518504 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4d4e888-6458-429e-8cec-087f8b05a249 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:21.519584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4d4e888-6458-429e-8cec-087f8b05a249 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:21.519863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4d4e888-6458-429e-8cec-087f8b05a249 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:21.520335 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4d4e888-6458-429e-8cec-087f8b05a249 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:21.587278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f4d4e888-6458-429e-8cec-087f8b05a249 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:21.595102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f4d4e888-6458-429e-8cec-087f8b05a249 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.089971 Jul 04 06:04:21.595820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 651/1307] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:21 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:22.086753 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-434bc3f4-6119-42b6-82ad-0be4850cb3e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:22.087867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-434bc3f4-6119-42b6-82ad-0be4850cb3e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:22.096046 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-434bc3f4-6119-42b6-82ad-0be4850cb3e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:22.096577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-434bc3f4-6119-42b6-82ad-0be4850cb3e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:22.097478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-434bc3f4-6119-42b6-82ad-0be4850cb3e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:22.097996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-434bc3f4-6119-42b6-82ad-0be4850cb3e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:22.134486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-434bc3f4-6119-42b6-82ad-0be4850cb3e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053668 Jul 04 06:04:22.135076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 657/1308] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:22.618477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-174f969e-0ed0-492d-8d36-a9c3bf611911 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:22.619627 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-174f969e-0ed0-492d-8d36-a9c3bf611911 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:22.629880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-174f969e-0ed0-492d-8d36-a9c3bf611911 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:22.630325 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-174f969e-0ed0-492d-8d36-a9c3bf611911 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:22.631096 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-174f969e-0ed0-492d-8d36-a9c3bf611911 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:22.631562 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-174f969e-0ed0-492d-8d36-a9c3bf611911 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:22.699941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-174f969e-0ed0-492d-8d36-a9c3bf611911 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:22.707647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-174f969e-0ed0-492d-8d36-a9c3bf611911 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.097761 Jul 04 06:04:22.708210 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 652/1309] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:22 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:23.150702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-25c93ea1-0015-48fe-aee9-c004e92638b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:23.152197 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-25c93ea1-0015-48fe-aee9-c004e92638b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:23.155887 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=58 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:23.163795 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25c93ea1-0015-48fe-aee9-c004e92638b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:23.164237 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25c93ea1-0015-48fe-aee9-c004e92638b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:23.164995 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25c93ea1-0015-48fe-aee9-c004e92638b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:23.165419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25c93ea1-0015-48fe-aee9-c004e92638b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:23.196447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-25c93ea1-0015-48fe-aee9-c004e92638b8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052533 Jul 04 06:04:23.197011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 658/1310] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:23.724852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-41db31e3-4d47-455b-9418-9e30d3d800af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:23.725506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-41db31e3-4d47-455b-9418-9e30d3d800af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:23.732142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41db31e3-4d47-455b-9418-9e30d3d800af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:23.732596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41db31e3-4d47-455b-9418-9e30d3d800af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:23.733359 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41db31e3-4d47-455b-9418-9e30d3d800af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:23.733796 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41db31e3-4d47-455b-9418-9e30d3d800af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:23.803746 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-41db31e3-4d47-455b-9418-9e30d3d800af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:23.811459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-41db31e3-4d47-455b-9418-9e30d3d800af tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.090448 Jul 04 06:04:23.812045 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 653/1311] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:23 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:24.211190 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ade9e823-623d-4b48-bc76-455c5c4e04e0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:24.212162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ade9e823-623d-4b48-bc76-455c5c4e04e0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:24.219359 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ade9e823-623d-4b48-bc76-455c5c4e04e0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:24.219800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ade9e823-623d-4b48-bc76-455c5c4e04e0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:24.220576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ade9e823-623d-4b48-bc76-455c5c4e04e0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:24.221006 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ade9e823-623d-4b48-bc76-455c5c4e04e0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:24.252765 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ade9e823-623d-4b48-bc76-455c5c4e04e0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047450 Jul 04 06:04:24.256760 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 659/1312] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:24.832485 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-760fc968-3cfa-4936-a44c-399ddfbe294c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:24.833509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-760fc968-3cfa-4936-a44c-399ddfbe294c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:24.844675 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-760fc968-3cfa-4936-a44c-399ddfbe294c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:24.845422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-760fc968-3cfa-4936-a44c-399ddfbe294c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:24.846700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-760fc968-3cfa-4936-a44c-399ddfbe294c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:24.847467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-760fc968-3cfa-4936-a44c-399ddfbe294c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:24.916999 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-760fc968-3cfa-4936-a44c-399ddfbe294c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:24.928691 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-760fc968-3cfa-4936-a44c-399ddfbe294c tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.102850 Jul 04 06:04:24.929258 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 654/1313] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:24 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:25.269046 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3747695c-9fbd-4e74-9f39-4eed6dcd8ab6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:25.270616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3747695c-9fbd-4e74-9f39-4eed6dcd8ab6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:25.282207 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3747695c-9fbd-4e74-9f39-4eed6dcd8ab6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:25.282962 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3747695c-9fbd-4e74-9f39-4eed6dcd8ab6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:25.284280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3747695c-9fbd-4e74-9f39-4eed6dcd8ab6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:25.285012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3747695c-9fbd-4e74-9f39-4eed6dcd8ab6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:25.316720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3747695c-9fbd-4e74-9f39-4eed6dcd8ab6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054329 Jul 04 06:04:25.317327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 660/1314] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:25.948470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01c036c1-6721-4630-80b2-b39c5c18830d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:25.949103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01c036c1-6721-4630-80b2-b39c5c18830d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:25.956446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c036c1-6721-4630-80b2-b39c5c18830d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:25.956947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c036c1-6721-4630-80b2-b39c5c18830d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:25.957796 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c036c1-6721-4630-80b2-b39c5c18830d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:25.958309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01c036c1-6721-4630-80b2-b39c5c18830d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:26.023737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01c036c1-6721-4630-80b2-b39c5c18830d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac9756c145040e58f9d914ba5bcdfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d701a66ecbb480fa08e97f304acf57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:26.031762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01c036c1-6721-4630-80b2-b39c5c18830d tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 200 len: 1152 microversion: 2.1 time: 0.088590 Jul 04 06:04:26.032322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 655/1315] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:25 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 1152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:04:26.047993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:26.048429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:26.054702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:26.055149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:26.055948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:26.056423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:26.082107 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:04:26.091720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:26.092170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:26.137585 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lazy-loading 'flavor' on Instance uuid 062c25e3-dd25-4cec-ba2c-b7c41f7103c4 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:04:26.149155 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lazy-loading 'system_metadata' on Instance uuid 062c25e3-dd25-4cec-ba2c-b7c41f7103c4 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:04:26.207512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lazy-loading 'metadata' on Instance uuid 062c25e3-dd25-4cec-ba2c-b7c41f7103c4 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:04:26.329387 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-767e8027-f914-4880-bb33-7b3b10aeefa9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:26.330333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-767e8027-f914-4880-bb33-7b3b10aeefa9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:26.336951 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-767e8027-f914-4880-bb33-7b3b10aeefa9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:26.337428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-767e8027-f914-4880-bb33-7b3b10aeefa9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:26.338244 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-767e8027-f914-4880-bb33-7b3b10aeefa9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:26.338745 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-767e8027-f914-4880-bb33-7b3b10aeefa9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:26.373127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-767e8027-f914-4880-bb33-7b3b10aeefa9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048373 Jul 04 06:04:26.377630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 656/1316] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:04:26.527529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.scheduler.client.report [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Deleted allocations for instance 062c25e3-dd25-4cec-ba2c-b7c41f7103c4 Jul 04 06:04:26.551750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0e1e8f7d-da49-4a50-8ac9-215c2563e4cb tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "DELETE /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 204 len: 0 microversion: 2.1 time: 0.507715 Jul 04 06:04:26.552487 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 661/1317] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:04:26 2022] DELETE /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 06:04:26.560627 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a251f2ed-d0c6-4057-af28-8b54403778c8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:26.561322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a251f2ed-d0c6-4057-af28-8b54403778c8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [instance: 062c25e3-dd25-4cec-ba2c-b7c41f7103c4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:26.567776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a251f2ed-d0c6-4057-af28-8b54403778c8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:26.568225 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a251f2ed-d0c6-4057-af28-8b54403778c8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:26.568989 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a251f2ed-d0c6-4057-af28-8b54403778c8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:26.569423 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a251f2ed-d0c6-4057-af28-8b54403778c8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:26.583517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-a251f2ed-d0c6-4057-af28-8b54403778c8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] HTTP exception thrown: Instance 062c25e3-dd25-4cec-ba2c-b7c41f7103c4 could not be found. Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a251f2ed-d0c6-4057-af28-8b54403778c8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Request method failure captured: Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 HTTP/1.1 Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoFm3-Ze6c3vZ4vtzCnomIskEqUyduhKWi0GUuUnA4wPyi4LV0qKdEg_zJ14iphFBF6UbarwkGnmEXXMkgHKih5FWEAIdrEh0r77iqnc9VFH1EOvIf44_JADQsD-0KrkaBa1i2pSaSqv50CL9vuRD6YcbWIrtzX3SkBsuJ1ir1DOXDk Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 8d701a66ecbb480fa08e97f304acf57b Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestVolumeBootPattern-603168068 Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:04:26.585262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d701a66ecbb480fa08e97f304acf57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d701a66ecbb480fa08e97f304acf57b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d701a66ecbb480fa08e97f304acf57b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d701a66ecbb480fa08e97f304acf57b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestVolumeBootPattern-603168068 Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 8d701a66ecbb480fa08e97f304acf57b Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestVolumeBootPattern-603168068 Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-TestVolumeBootPattern-603168068-project Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 6ac9756c145040e58f9d914ba5bcdfaa Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestVolumeBootPattern-603168068-project Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 062c25e3-dd25-4cec-ba2c-b7c41f7103c4 could not be found. Jul 04 06:04:26.587036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '062c25e3-dd25-4cec-ba2c-b7c41f7103c4'} Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 062c25e3-dd25-4cec-ba2c-b7c41f7103c4 could not be found. Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:04:26.588017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 062c25e3-dd25-4cec-ba2c-b7c41f7103c4 could not be found. Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 062c25e3-dd25-4cec-ba2c-b7c41f7103c4 could not be found. Jul 04 06:04:26.589728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:04:26.591164 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a251f2ed-d0c6-4057-af28-8b54403778c8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Returning 404 to user: Instance 062c25e3-dd25-4cec-ba2c-b7c41f7103c4 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:04:26.591164 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a251f2ed-d0c6-4057-af28-8b54403778c8 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4" status: 404 len: 111 microversion: 2.1 time: 0.030762 Jul 04 06:04:26.591164 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 657/1318] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:26 2022] GET /compute/v2.1/servers/062c25e3-dd25-4cec-ba2c-b7c41f7103c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 06:04:27.391947 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e35188d0-2c2b-4eba-86c0-d59727cd6ca3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:27.393745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e35188d0-2c2b-4eba-86c0-d59727cd6ca3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:27.402630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e35188d0-2c2b-4eba-86c0-d59727cd6ca3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:27.403454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e35188d0-2c2b-4eba-86c0-d59727cd6ca3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:27.404229 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e35188d0-2c2b-4eba-86c0-d59727cd6ca3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:27.404661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e35188d0-2c2b-4eba-86c0-d59727cd6ca3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:27.435488 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e35188d0-2c2b-4eba-86c0-d59727cd6ca3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052156 Jul 04 06:04:27.436216 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 662/1319] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:28.450475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-775026c2-829f-4338-8953-2e2f6beb7db1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:28.452305 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-775026c2-829f-4338-8953-2e2f6beb7db1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:28.463366 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-775026c2-829f-4338-8953-2e2f6beb7db1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:28.463751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-775026c2-829f-4338-8953-2e2f6beb7db1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:28.464643 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-775026c2-829f-4338-8953-2e2f6beb7db1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:28.465353 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-775026c2-829f-4338-8953-2e2f6beb7db1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:28.495864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-775026c2-829f-4338-8953-2e2f6beb7db1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052235 Jul 04 06:04:28.496412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 658/1320] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:29.511781 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1752743c-7e68-4028-818e-8dad153678b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:29.515441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1752743c-7e68-4028-818e-8dad153678b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:29.527457 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1752743c-7e68-4028-818e-8dad153678b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:29.527457 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1752743c-7e68-4028-818e-8dad153678b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:29.528521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1752743c-7e68-4028-818e-8dad153678b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:29.529158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1752743c-7e68-4028-818e-8dad153678b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:29.560939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1752743c-7e68-4028-818e-8dad153678b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056495 Jul 04 06:04:29.561511 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 663/1321] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:30.574042 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c8fb4795-7c1c-443c-be8f-3342d4c5cb45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:30.574965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c8fb4795-7c1c-443c-be8f-3342d4c5cb45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:30.577871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=56 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:30.582791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8fb4795-7c1c-443c-be8f-3342d4c5cb45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:30.583237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8fb4795-7c1c-443c-be8f-3342d4c5cb45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:30.584031 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8fb4795-7c1c-443c-be8f-3342d4c5cb45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:30.584457 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8fb4795-7c1c-443c-be8f-3342d4c5cb45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:30.615272 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c8fb4795-7c1c-443c-be8f-3342d4c5cb45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045962 Jul 04 06:04:30.615850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 659/1322] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:30 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:30.783826 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d012a305-3db4-41d4-839d-2f7995ada5e2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:30.784335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d012a305-3db4-41d4-839d-2f7995ada5e2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:30.790906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d012a305-3db4-41d4-839d-2f7995ada5e2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:30.791386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d012a305-3db4-41d4-839d-2f7995ada5e2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:30.792141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d012a305-3db4-41d4-839d-2f7995ada5e2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:30.792568 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d012a305-3db4-41d4-839d-2f7995ada5e2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:30.920023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-d012a305-3db4-41d4-839d-2f7995ada5e2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lazy-loading 'services' on Instance uuid 9120ac5f-6d50-4583-adae-9bc3766e686f {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:04:31.020669 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d012a305-3db4-41d4-839d-2f7995ada5e2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f/os-volume_attachments/2eb6f4e4-3483-45a1-baf3-1f11787d1d06" status: 202 len: 0 microversion: 2.1 time: 0.240564 Jul 04 06:04:31.021302 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 664/1323] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jul 4 06:04:30 2022] DELETE /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f/os-volume_attachments/2eb6f4e4-3483-45a1-baf3-1f11787d1d06 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:04:31.627981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-53f625aa-aea1-45b2-b953-10ea6144a5f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:31.629052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-53f625aa-aea1-45b2-b953-10ea6144a5f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:31.637750 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53f625aa-aea1-45b2-b953-10ea6144a5f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:31.638270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53f625aa-aea1-45b2-b953-10ea6144a5f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:31.639159 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53f625aa-aea1-45b2-b953-10ea6144a5f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:31.639703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53f625aa-aea1-45b2-b953-10ea6144a5f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:31.672156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-53f625aa-aea1-45b2-b953-10ea6144a5f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048770 Jul 04 06:04:31.672858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 660/1324] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:31 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:32.689908 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a072c04-9534-49eb-9eee-1c315c6efd86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:32.692727 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a072c04-9534-49eb-9eee-1c315c6efd86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:32.703092 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a072c04-9534-49eb-9eee-1c315c6efd86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:32.703574 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a072c04-9534-49eb-9eee-1c315c6efd86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:32.704403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a072c04-9534-49eb-9eee-1c315c6efd86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:32.706593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a072c04-9534-49eb-9eee-1c315c6efd86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:32.734884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a072c04-9534-49eb-9eee-1c315c6efd86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053470 Jul 04 06:04:32.735469 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 665/1325] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:32 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:33.749879 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-da6ae28f-b7c4-4eaa-aab1-d234148e724d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:33.751614 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-da6ae28f-b7c4-4eaa-aab1-d234148e724d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:33.762595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da6ae28f-b7c4-4eaa-aab1-d234148e724d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:33.763051 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da6ae28f-b7c4-4eaa-aab1-d234148e724d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:33.763862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da6ae28f-b7c4-4eaa-aab1-d234148e724d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:33.764304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da6ae28f-b7c4-4eaa-aab1-d234148e724d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:33.795211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-da6ae28f-b7c4-4eaa-aab1-d234148e724d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051864 Jul 04 06:04:33.795800 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 661/1326] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:34.809617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f2005b18-3db9-405e-b5f4-04a4fc150e18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:34.810806 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f2005b18-3db9-405e-b5f4-04a4fc150e18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:34.817547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2005b18-3db9-405e-b5f4-04a4fc150e18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:34.817993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2005b18-3db9-405e-b5f4-04a4fc150e18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:34.818740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2005b18-3db9-405e-b5f4-04a4fc150e18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:34.819159 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2005b18-3db9-405e-b5f4-04a4fc150e18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:34.848419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f2005b18-3db9-405e-b5f4-04a4fc150e18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045024 Jul 04 06:04:34.848973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 666/1327] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:35.862071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e067c864-3288-40d1-9457-0c8a8b686331 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:35.863211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e067c864-3288-40d1-9457-0c8a8b686331 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:35.871918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e067c864-3288-40d1-9457-0c8a8b686331 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:35.872477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e067c864-3288-40d1-9457-0c8a8b686331 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:35.873407 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e067c864-3288-40d1-9457-0c8a8b686331 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:35.873977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e067c864-3288-40d1-9457-0c8a8b686331 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:35.908772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e067c864-3288-40d1-9457-0c8a8b686331 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051627 Jul 04 06:04:35.909329 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 662/1328] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:36.924235 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fdde9b8a-99e6-413d-8818-ee306674dde5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:36.925980 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fdde9b8a-99e6-413d-8818-ee306674dde5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:36.935702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdde9b8a-99e6-413d-8818-ee306674dde5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:36.936146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdde9b8a-99e6-413d-8818-ee306674dde5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:36.936916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdde9b8a-99e6-413d-8818-ee306674dde5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:36.937351 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdde9b8a-99e6-413d-8818-ee306674dde5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:36.951295 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=11,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:36.969411 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fdde9b8a-99e6-413d-8818-ee306674dde5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051721 Jul 04 06:04:36.969961 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 667/1329] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:37.980867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5e16fc91-8210-4b48-acb2-cd6621c24ee4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:37.981794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5e16fc91-8210-4b48-acb2-cd6621c24ee4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:37.988480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e16fc91-8210-4b48-acb2-cd6621c24ee4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:37.988961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e16fc91-8210-4b48-acb2-cd6621c24ee4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:37.989727 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e16fc91-8210-4b48-acb2-cd6621c24ee4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:37.990162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e16fc91-8210-4b48-acb2-cd6621c24ee4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:38.015729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:38.020623 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5e16fc91-8210-4b48-acb2-cd6621c24ee4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Jul 04 06:04:38.021155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 663/1330] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:39.033397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0f6fd24f-fee1-4c1a-a91b-d0666d8617d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:39.034620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0f6fd24f-fee1-4c1a-a91b-d0666d8617d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:39.044069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f6fd24f-fee1-4c1a-a91b-d0666d8617d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:39.044498 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f6fd24f-fee1-4c1a-a91b-d0666d8617d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:39.045253 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f6fd24f-fee1-4c1a-a91b-d0666d8617d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:39.045684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f6fd24f-fee1-4c1a-a91b-d0666d8617d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:39.075390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0f6fd24f-fee1-4c1a-a91b-d0666d8617d2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045848 Jul 04 06:04:39.075936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 668/1331] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:40.091287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7e9d2f7e-44f1-49b1-a331-67b6d9d61b12 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:40.092201 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7e9d2f7e-44f1-49b1-a331-67b6d9d61b12 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:40.099071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e9d2f7e-44f1-49b1-a331-67b6d9d61b12 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:40.099545 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e9d2f7e-44f1-49b1-a331-67b6d9d61b12 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:40.100405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e9d2f7e-44f1-49b1-a331-67b6d9d61b12 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:40.100843 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e9d2f7e-44f1-49b1-a331-67b6d9d61b12 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:40.131576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7e9d2f7e-44f1-49b1-a331-67b6d9d61b12 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047340 Jul 04 06:04:40.132132 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 664/1332] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:41.144662 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3d47cabd-6928-40b4-bb65-45b1458e2c85 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:41.145883 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3d47cabd-6928-40b4-bb65-45b1458e2c85 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:41.154057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d47cabd-6928-40b4-bb65-45b1458e2c85 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:41.154582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d47cabd-6928-40b4-bb65-45b1458e2c85 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:41.155544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d47cabd-6928-40b4-bb65-45b1458e2c85 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:41.156053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d47cabd-6928-40b4-bb65-45b1458e2c85 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:41.191533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3d47cabd-6928-40b4-bb65-45b1458e2c85 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051437 Jul 04 06:04:41.192260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 669/1333] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:41 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:42.207830 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1213fab4-d3b0-4e06-b9f8-e9298061c72f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:42.209316 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1213fab4-d3b0-4e06-b9f8-e9298061c72f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:42.219628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1213fab4-d3b0-4e06-b9f8-e9298061c72f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:42.220086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1213fab4-d3b0-4e06-b9f8-e9298061c72f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:42.220781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1213fab4-d3b0-4e06-b9f8-e9298061c72f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:42.221210 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1213fab4-d3b0-4e06-b9f8-e9298061c72f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:42.251216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1213fab4-d3b0-4e06-b9f8-e9298061c72f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050453 Jul 04 06:04:42.251791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 665/1334] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:42 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:43.266352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4eb578dc-113f-436e-a468-1ef67b70f23b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:43.267285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4eb578dc-113f-436e-a468-1ef67b70f23b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:43.274157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4eb578dc-113f-436e-a468-1ef67b70f23b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:43.274605 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4eb578dc-113f-436e-a468-1ef67b70f23b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:43.275403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4eb578dc-113f-436e-a468-1ef67b70f23b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:43.275851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4eb578dc-113f-436e-a468-1ef67b70f23b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:43.306282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4eb578dc-113f-436e-a468-1ef67b70f23b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046793 Jul 04 06:04:43.306864 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 670/1335] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:44.319087 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cf645183-82a9-4996-91aa-11a79bd33ac6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:44.320160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cf645183-82a9-4996-91aa-11a79bd33ac6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:44.327744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf645183-82a9-4996-91aa-11a79bd33ac6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:44.328238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf645183-82a9-4996-91aa-11a79bd33ac6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:44.329075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf645183-82a9-4996-91aa-11a79bd33ac6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:44.329552 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf645183-82a9-4996-91aa-11a79bd33ac6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:44.360305 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cf645183-82a9-4996-91aa-11a79bd33ac6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Jul 04 06:04:44.361044 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 666/1336] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:44 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:45.376759 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f1c9a674-3932-4ce2-8916-0d32334ce2fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:45.378238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f1c9a674-3932-4ce2-8916-0d32334ce2fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:45.389357 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1c9a674-3932-4ce2-8916-0d32334ce2fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:45.390071 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1c9a674-3932-4ce2-8916-0d32334ce2fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:45.391201 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1c9a674-3932-4ce2-8916-0d32334ce2fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:45.391664 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1c9a674-3932-4ce2-8916-0d32334ce2fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:45.421470 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f1c9a674-3932-4ce2-8916-0d32334ce2fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051432 Jul 04 06:04:45.422063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 671/1337] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:46.438339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff50ab60-cf8c-494e-8d72-6c795bde8150 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:46.439280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff50ab60-cf8c-494e-8d72-6c795bde8150 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:46.446103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff50ab60-cf8c-494e-8d72-6c795bde8150 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:46.446539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff50ab60-cf8c-494e-8d72-6c795bde8150 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:46.447333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff50ab60-cf8c-494e-8d72-6c795bde8150 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:46.447772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff50ab60-cf8c-494e-8d72-6c795bde8150 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:46.478108 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff50ab60-cf8c-494e-8d72-6c795bde8150 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Jul 04 06:04:46.478659 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 667/1338] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:46 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:47.495007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6aa6a570-2968-4cea-b45d-18e7353f0e93 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:47.496589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6aa6a570-2968-4cea-b45d-18e7353f0e93 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:47.507189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aa6a570-2968-4cea-b45d-18e7353f0e93 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:47.507851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aa6a570-2968-4cea-b45d-18e7353f0e93 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:47.508721 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aa6a570-2968-4cea-b45d-18e7353f0e93 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:47.509152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6aa6a570-2968-4cea-b45d-18e7353f0e93 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:47.540290 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6aa6a570-2968-4cea-b45d-18e7353f0e93 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053266 Jul 04 06:04:47.540839 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 672/1339] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:48.551829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a3ba828b-33ac-45d0-9efa-5f8eabe14592 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:48.552758 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a3ba828b-33ac-45d0-9efa-5f8eabe14592 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:48.559302 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3ba828b-33ac-45d0-9efa-5f8eabe14592 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:48.559772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3ba828b-33ac-45d0-9efa-5f8eabe14592 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:48.560540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3ba828b-33ac-45d0-9efa-5f8eabe14592 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:48.560979 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3ba828b-33ac-45d0-9efa-5f8eabe14592 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:48.590840 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a3ba828b-33ac-45d0-9efa-5f8eabe14592 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 Jul 04 06:04:48.591444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 668/1340] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:49.602516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fe4d8205-f1ba-406f-bf0d-af2b6e87f678 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:49.603687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fe4d8205-f1ba-406f-bf0d-af2b6e87f678 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:49.611054 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe4d8205-f1ba-406f-bf0d-af2b6e87f678 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:49.611596 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe4d8205-f1ba-406f-bf0d-af2b6e87f678 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:49.612466 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe4d8205-f1ba-406f-bf0d-af2b6e87f678 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:49.612959 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe4d8205-f1ba-406f-bf0d-af2b6e87f678 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:49.645861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fe4d8205-f1ba-406f-bf0d-af2b6e87f678 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047676 Jul 04 06:04:49.646414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 673/1341] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:50.660808 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2ec11f67-919a-4868-944a-8f27b7c3dda1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:50.662178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2ec11f67-919a-4868-944a-8f27b7c3dda1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:50.672745 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ec11f67-919a-4868-944a-8f27b7c3dda1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:50.673253 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ec11f67-919a-4868-944a-8f27b7c3dda1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:50.674011 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ec11f67-919a-4868-944a-8f27b7c3dda1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:50.674444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ec11f67-919a-4868-944a-8f27b7c3dda1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:50.703864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2ec11f67-919a-4868-944a-8f27b7c3dda1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048973 Jul 04 06:04:50.704429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 669/1342] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:50 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:51.718481 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-897ea1d5-264a-444d-8989-949ea29eb75b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:51.719717 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-897ea1d5-264a-444d-8989-949ea29eb75b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:51.726451 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-897ea1d5-264a-444d-8989-949ea29eb75b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:51.726904 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-897ea1d5-264a-444d-8989-949ea29eb75b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:51.727730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-897ea1d5-264a-444d-8989-949ea29eb75b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:51.728141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-897ea1d5-264a-444d-8989-949ea29eb75b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:51.763747 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-897ea1d5-264a-444d-8989-949ea29eb75b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051885 Jul 04 06:04:51.764323 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 674/1343] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:51 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:52.779647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab15a46c-65fe-418e-97b2-89580400c7cf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:52.781527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab15a46c-65fe-418e-97b2-89580400c7cf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:52.788474 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab15a46c-65fe-418e-97b2-89580400c7cf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:52.788890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab15a46c-65fe-418e-97b2-89580400c7cf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:52.789698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab15a46c-65fe-418e-97b2-89580400c7cf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:52.790129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab15a46c-65fe-418e-97b2-89580400c7cf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:52.821847 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab15a46c-65fe-418e-97b2-89580400c7cf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049119 Jul 04 06:04:52.822393 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 670/1344] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:52 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:53.833746 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0a51c132-843b-47ce-90aa-d7a23a4eaee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:53.834693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0a51c132-843b-47ce-90aa-d7a23a4eaee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:53.837195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:53.842595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a51c132-843b-47ce-90aa-d7a23a4eaee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:53.843028 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a51c132-843b-47ce-90aa-d7a23a4eaee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:53.843814 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a51c132-843b-47ce-90aa-d7a23a4eaee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:53.844240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a51c132-843b-47ce-90aa-d7a23a4eaee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:53.876723 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0a51c132-843b-47ce-90aa-d7a23a4eaee9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046855 Jul 04 06:04:53.877260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 675/1345] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:53 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:54.899926 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4747254e-7223-4a5c-bac0-05aa973240dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:54.902760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4747254e-7223-4a5c-bac0-05aa973240dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:54.913144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4747254e-7223-4a5c-bac0-05aa973240dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:54.913599 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4747254e-7223-4a5c-bac0-05aa973240dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:54.914554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4747254e-7223-4a5c-bac0-05aa973240dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:54.914806 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4747254e-7223-4a5c-bac0-05aa973240dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:54.944698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4747254e-7223-4a5c-bac0-05aa973240dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057082 Jul 04 06:04:54.945245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 671/1346] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:55.957239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0adbbbc9-8d9f-47af-b2aa-d0fab6e4b231 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:55.958167 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0adbbbc9-8d9f-47af-b2aa-d0fab6e4b231 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:55.964877 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0adbbbc9-8d9f-47af-b2aa-d0fab6e4b231 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:55.965328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0adbbbc9-8d9f-47af-b2aa-d0fab6e4b231 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:55.966095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0adbbbc9-8d9f-47af-b2aa-d0fab6e4b231 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:55.966531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0adbbbc9-8d9f-47af-b2aa-d0fab6e4b231 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:55.996325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0adbbbc9-8d9f-47af-b2aa-d0fab6e4b231 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Jul 04 06:04:55.996871 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 676/1347] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:57.009203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6f63fc47-23de-4009-9711-a895a46d5d15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:57.010139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6f63fc47-23de-4009-9711-a895a46d5d15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:57.016752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f63fc47-23de-4009-9711-a895a46d5d15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:57.017205 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f63fc47-23de-4009-9711-a895a46d5d15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:57.017964 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f63fc47-23de-4009-9711-a895a46d5d15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:57.018393 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f63fc47-23de-4009-9711-a895a46d5d15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:57.048267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6f63fc47-23de-4009-9711-a895a46d5d15 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043045 Jul 04 06:04:57.048824 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 672/1348] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:57 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:58.061479 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-99f879e9-38e0-491a-ac73-7786d2bdea25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:58.062730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-99f879e9-38e0-491a-ac73-7786d2bdea25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:58.070741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f879e9-38e0-491a-ac73-7786d2bdea25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:58.071353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f879e9-38e0-491a-ac73-7786d2bdea25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:58.072283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f879e9-38e0-491a-ac73-7786d2bdea25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:58.072806 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99f879e9-38e0-491a-ac73-7786d2bdea25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:58.104101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-99f879e9-38e0-491a-ac73-7786d2bdea25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047508 Jul 04 06:04:58.104670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 677/1349] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:59.120109 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3f8d4ec8-d923-491d-b805-4c9a6595c04e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:59.121618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3f8d4ec8-d923-491d-b805-4c9a6595c04e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:59.131342 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f8d4ec8-d923-491d-b805-4c9a6595c04e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:59.131794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f8d4ec8-d923-491d-b805-4c9a6595c04e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:59.132568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f8d4ec8-d923-491d-b805-4c9a6595c04e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:59.133009 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f8d4ec8-d923-491d-b805-4c9a6595c04e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:59.163017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3f8d4ec8-d923-491d-b805-4c9a6595c04e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049838 Jul 04 06:04:59.163620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 673/1350] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:04:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:04:59.323460 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c6235b7f-7340-46aa-a2d4-9380217169b3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:59.324045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c6235b7f-7340-46aa-a2d4-9380217169b3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:59.330246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6235b7f-7340-46aa-a2d4-9380217169b3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:59.330689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6235b7f-7340-46aa-a2d4-9380217169b3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:59.331484 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6235b7f-7340-46aa-a2d4-9380217169b3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:59.331909 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6235b7f-7340-46aa-a2d4-9380217169b3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:59.358097 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c6235b7f-7340-46aa-a2d4-9380217169b3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:04:59.439452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c6235b7f-7340-46aa-a2d4-9380217169b3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 204 len: 0 microversion: 2.1 time: 0.119536 Jul 04 06:04:59.440033 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 678/1351] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:04:59 2022] DELETE /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 06:04:59.448777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-86d747d4-428e-4d30-8d38-1f3bf476c582 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:04:59.449390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-86d747d4-428e-4d30-8d38-1f3bf476c582 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:04:59.455770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86d747d4-428e-4d30-8d38-1f3bf476c582 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:59.456226 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86d747d4-428e-4d30-8d38-1f3bf476c582 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:59.456995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86d747d4-428e-4d30-8d38-1f3bf476c582 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:04:59.457435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86d747d4-428e-4d30-8d38-1f3bf476c582 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:04:59.603682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-86d747d4-428e-4d30-8d38-1f3bf476c582 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:04:59.611988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-86d747d4-428e-4d30-8d38-1f3bf476c582 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1680 microversion: 2.1 time: 0.167315 Jul 04 06:04:59.612558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 674/1352] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:04:59 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:05:00.174880 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0761f3dc-5ccd-4de0-8301-80c9061112d7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:00.176020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0761f3dc-5ccd-4de0-8301-80c9061112d7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:00.182496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0761f3dc-5ccd-4de0-8301-80c9061112d7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:00.183012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0761f3dc-5ccd-4de0-8301-80c9061112d7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:00.183874 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0761f3dc-5ccd-4de0-8301-80c9061112d7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:00.184388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0761f3dc-5ccd-4de0-8301-80c9061112d7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:00.215614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0761f3dc-5ccd-4de0-8301-80c9061112d7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045230 Jul 04 06:05:00.216241 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 679/1353] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:00 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:00.632304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-40457687-ec22-48cd-8e87-de002a1bbe2f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:00.632766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-40457687-ec22-48cd-8e87-de002a1bbe2f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:00.634720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=32 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:00.641557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40457687-ec22-48cd-8e87-de002a1bbe2f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:00.642000 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40457687-ec22-48cd-8e87-de002a1bbe2f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:00.642777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40457687-ec22-48cd-8e87-de002a1bbe2f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:00.643209 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40457687-ec22-48cd-8e87-de002a1bbe2f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:00.707148 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-40457687-ec22-48cd-8e87-de002a1bbe2f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:05:00.714763 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-40457687-ec22-48cd-8e87-de002a1bbe2f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 200 len: 1613 microversion: 2.1 time: 0.087780 Jul 04 06:05:00.715348 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 675/1354] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:05:00 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:05:00.962889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-6f716b3c-2447-405a-9de1-5c5529478101 req-966cd243-2215-41cc-97ae-174803d32ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad9b47c-9ec3-4208-baf7-6743e129f162", "name": "network-vif-deleted", "tag": "7c47e3eb-c2ec-4ceb-8f41-d4bd404babd5"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:05:00.972663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6f716b3c-2447-405a-9de1-5c5529478101 req-966cd243-2215-41cc-97ae-174803d32ee4 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:00.973517 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6f716b3c-2447-405a-9de1-5c5529478101 req-966cd243-2215-41cc-97ae-174803d32ee4 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:00.992661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-6f716b3c-2447-405a-9de1-5c5529478101 req-966cd243-2215-41cc-97ae-174803d32ee4 service nova] Creating event network-vif-deleted:7c47e3eb-c2ec-4ceb-8f41-d4bd404babd5 for instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 on hv-cinder-79733 Jul 04 06:05:00.998945 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-6f716b3c-2447-405a-9de1-5c5529478101 req-966cd243-2215-41cc-97ae-174803d32ee4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102291 Jul 04 06:05:01.003047 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 680/1355] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:01.227239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-22507900-7780-4f55-9b22-75388dae757e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:01.228353 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-22507900-7780-4f55-9b22-75388dae757e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:01.234633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22507900-7780-4f55-9b22-75388dae757e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:01.235065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22507900-7780-4f55-9b22-75388dae757e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:01.235873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22507900-7780-4f55-9b22-75388dae757e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:01.236312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22507900-7780-4f55-9b22-75388dae757e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:01.266673 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-22507900-7780-4f55-9b22-75388dae757e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043330 Jul 04 06:05:01.270527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 676/1356] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:01 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:01.733322 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c556c391-cccd-4b38-b857-5ccd8363e80f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:01.734018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c556c391-cccd-4b38-b857-5ccd8363e80f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:01.740926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c556c391-cccd-4b38-b857-5ccd8363e80f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:01.741373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c556c391-cccd-4b38-b857-5ccd8363e80f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:01.742146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c556c391-cccd-4b38-b857-5ccd8363e80f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:01.742579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c556c391-cccd-4b38-b857-5ccd8363e80f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:01.756592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-c556c391-cccd-4b38-b857-5ccd8363e80f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c556c391-cccd-4b38-b857-5ccd8363e80f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 HTTP/1.1 Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 06:05:01.758268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:05:01.759734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '9ad9b47c-9ec3-4208-baf7-6743e129f162'} Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:05:01.760547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:05:01.762338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:05:01.763943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c556c391-cccd-4b38-b857-5ccd8363e80f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:05:01.763943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c556c391-cccd-4b38-b857-5ccd8363e80f tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 404 len: 111 microversion: 2.1 time: 0.030724 Jul 04 06:05:01.763943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 681/1357] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:05:01 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:05:01.769051 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-02714ca1-6ac0-48fd-845d-19ad24076db6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '.version_select at 0x7f204d3f0af0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:01.792431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-02714ca1-6ac0-48fd-845d-19ad24076db6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903286229" status: 202 len: 0 microversion: 2.1 time: 0.027347 Jul 04 06:05:01.793057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 677/1358] 10.222.0.42 () {58 vars in 1220 bytes} [Mon Jul 4 06:05:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903286229 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:05:02.278149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-feb44d48-b594-422b-8772-a90f081585c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:02.279562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-feb44d48-b594-422b-8772-a90f081585c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:02.286263 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feb44d48-b594-422b-8772-a90f081585c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:02.293020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feb44d48-b594-422b-8772-a90f081585c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:02.293899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feb44d48-b594-422b-8772-a90f081585c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:02.294439 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feb44d48-b594-422b-8772-a90f081585c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:02.324618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-feb44d48-b594-422b-8772-a90f081585c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050639 Jul 04 06:05:02.325438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 682/1359] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:02 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:02.467756 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75a4d4f7-6617-429c-9a5f-2bfa5d3a09ef tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Action: 'create', calling method: .version_select at 0x7f20477c09d0>, body: {"keypair": {"name": "tempest-keypair-539974468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxp3cl/61xEkhU/DKNVjX0kdYexsobXrfP1OTo9AH7KVtXN+L+lnJac03q+nkWY7ee9tCPdcJJXUaZieOe/Nix+5uxA/JHI3dt7x/Iwv0iw27k/1TI2ZCXK/bihnLU/Zg=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:05:02.483280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-75a4d4f7-6617-429c-9a5f-2bfa5d3a09ef tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for project 4e16375231df4b768b8355e320e91731. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 06:05:02.487160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-75a4d4f7-6617-429c-9a5f-2bfa5d3a09ef tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for user e367c76dfa7f4d2791e60ce148f352c3 and project 4e16375231df4b768b8355e320e91731. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 06:05:02.512304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-75a4d4f7-6617-429c-9a5f-2bfa5d3a09ef tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048791 Jul 04 06:05:02.513174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 678/1360] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jul 4 06:05:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:03.336664 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2fdc5293-4a56-4962-b374-936e00fdc5fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:03.337703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2fdc5293-4a56-4962-b374-936e00fdc5fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:03.344906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fdc5293-4a56-4962-b374-936e00fdc5fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:03.345515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fdc5293-4a56-4962-b374-936e00fdc5fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:03.346381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fdc5293-4a56-4962-b374-936e00fdc5fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:03.346936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fdc5293-4a56-4962-b374-936e00fdc5fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:03.377660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:03.386074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2fdc5293-4a56-4962-b374-936e00fdc5fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054268 Jul 04 06:05:03.387190 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 683/1361] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:03.774979 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1087522903", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cff6865-4d61-43fd-b392-bb40cec9d37d"}], "security_groups": [{"name": "tempest-securitygroup--1813295432"}], "key_name": "tempest-keypair-539974468", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:05:03.889949 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] validate_networks() for [('9cff6865-4d61-43fd-b392-bb40cec9d37d', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 06:05:04.319122 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 06:05:04.319576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 06:05:04.320321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 06:05:04.320730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 06:05:04.321137 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 06:05:04.331125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:04.331641 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:04.332554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:04.332987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:04.351382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for project 4e16375231df4b768b8355e320e91731. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 06:05:04.355548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Getting quotas for user e367c76dfa7f4d2791e60ce148f352c3 and project 4e16375231df4b768b8355e320e91731. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 06:05:04.367390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 06:05:04.369626 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 06:05:04.402328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-edd6083e-ea1c-4889-9934-f74ccd4144b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:04.403341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-edd6083e-ea1c-4889-9934-f74ccd4144b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:04.414777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edd6083e-ea1c-4889-9934-f74ccd4144b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:04.415227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edd6083e-ea1c-4889-9934-f74ccd4144b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:04.416012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edd6083e-ea1c-4889-9934-f74ccd4144b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:04.416436 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edd6083e-ea1c-4889-9934-f74ccd4144b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:04.421972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-205549ee-4027-4230-8615-2aa15a8ab225 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.652085 Jul 04 06:05:04.422806 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 679/1362] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 06:05:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 06:05:04.432420 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2f2c428-7015-44e1-8256-6ebc63e0f713 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:04.433272 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c2f2c428-7015-44e1-8256-6ebc63e0f713 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:04.449044 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-edd6083e-ea1c-4889-9934-f74ccd4144b9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051933 Jul 04 06:05:04.449582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 684/1363] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:04.493337 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c2f2c428-7015-44e1-8256-6ebc63e0f713 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:05:04.500130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2f2c428-7015-44e1-8256-6ebc63e0f713 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 200 len: 1241 microversion: 2.1 time: 0.071432 Jul 04 06:05:04.500689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 680/1364] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:05:04 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:05:05.460514 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f7c33632-fdca-4be9-b76f-d171d963e85c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:05.461444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f7c33632-fdca-4be9-b76f-d171d963e85c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:05.467988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c33632-fdca-4be9-b76f-d171d963e85c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:05.468442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c33632-fdca-4be9-b76f-d171d963e85c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:05.469210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c33632-fdca-4be9-b76f-d171d963e85c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:05.469638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c33632-fdca-4be9-b76f-d171d963e85c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:05.501054 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f7c33632-fdca-4be9-b76f-d171d963e85c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044533 Jul 04 06:05:05.502259 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 685/1365] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:05 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:05.517828 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f13f9cdd-fbc9-49b3-ab91-0d1d8b90592d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:05.519471 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f13f9cdd-fbc9-49b3-ab91-0d1d8b90592d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:05.529665 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f13f9cdd-fbc9-49b3-ab91-0d1d8b90592d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:05.530118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f13f9cdd-fbc9-49b3-ab91-0d1d8b90592d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:05.530893 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f13f9cdd-fbc9-49b3-ab91-0d1d8b90592d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:05.531352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f13f9cdd-fbc9-49b3-ab91-0d1d8b90592d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:05.603206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f13f9cdd-fbc9-49b3-ab91-0d1d8b90592d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:05:05.610644 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f13f9cdd-fbc9-49b3-ab91-0d1d8b90592d tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 200 len: 1299 microversion: 2.1 time: 0.097250 Jul 04 06:05:05.611191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 681/1366] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:05:05 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:05:06.512935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3fd37643-5748-4331-81d4-89a92e45b4bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:06.515759 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3fd37643-5748-4331-81d4-89a92e45b4bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:06.523721 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fd37643-5748-4331-81d4-89a92e45b4bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:06.524183 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fd37643-5748-4331-81d4-89a92e45b4bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:06.524929 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fd37643-5748-4331-81d4-89a92e45b4bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:06.525354 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fd37643-5748-4331-81d4-89a92e45b4bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:06.584117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3fd37643-5748-4331-81d4-89a92e45b4bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075130 Jul 04 06:05:06.585288 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 686/1367] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:06.628037 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4c1bcccf-5db6-445f-b394-8bbfa5564695 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:06.628654 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4c1bcccf-5db6-445f-b394-8bbfa5564695 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:06.636085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c1bcccf-5db6-445f-b394-8bbfa5564695 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:06.636536 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c1bcccf-5db6-445f-b394-8bbfa5564695 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:06.637320 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c1bcccf-5db6-445f-b394-8bbfa5564695 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:06.637757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c1bcccf-5db6-445f-b394-8bbfa5564695 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:06.751660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-26a802e1-c905-4820-ac92-d036f89362ff req-26f2586a-cb26-4097-b5dc-dedd62943bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6fb72d-5a19-43fb-9fa5-b630aa555080", "tag": "b4adbb43-6f52-4a85-9b6e-f559845cec1e"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:05:06.765951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-26a802e1-c905-4820-ac92-d036f89362ff req-26f2586a-cb26-4097-b5dc-dedd62943bf0 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:06.766957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-26a802e1-c905-4820-ac92-d036f89362ff req-26f2586a-cb26-4097-b5dc-dedd62943bf0 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:06.786939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-26a802e1-c905-4820-ac92-d036f89362ff req-26f2586a-cb26-4097-b5dc-dedd62943bf0 service nova] Creating event network-changed:b4adbb43-6f52-4a85-9b6e-f559845cec1e for instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 on hv-cinder-79733 Jul 04 06:05:06.797139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-26a802e1-c905-4820-ac92-d036f89362ff req-26f2586a-cb26-4097-b5dc-dedd62943bf0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049584 Jul 04 06:05:06.799380 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 687/1368] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:06.802540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4c1bcccf-5db6-445f-b394-8bbfa5564695 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:05:06.810255 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4c1bcccf-5db6-445f-b394-8bbfa5564695 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 200 len: 1367 microversion: 2.1 time: 0.186171 Jul 04 06:05:06.810844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 682/1369] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:05:06 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:05:07.598783 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-658ff184-ace8-463f-b5f6-395d55e2f27d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:07.599785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-658ff184-ace8-463f-b5f6-395d55e2f27d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:07.606331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-658ff184-ace8-463f-b5f6-395d55e2f27d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:07.606776 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-658ff184-ace8-463f-b5f6-395d55e2f27d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:07.607865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-658ff184-ace8-463f-b5f6-395d55e2f27d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:07.608296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-658ff184-ace8-463f-b5f6-395d55e2f27d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:07.638276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-658ff184-ace8-463f-b5f6-395d55e2f27d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045486 Jul 04 06:05:07.638825 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 688/1370] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:07.831488 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b5367e0-15a4-435e-a215-0f624b9553b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:07.832382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4b5367e0-15a4-435e-a215-0f624b9553b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:07.839287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b5367e0-15a4-435e-a215-0f624b9553b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:07.839774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b5367e0-15a4-435e-a215-0f624b9553b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:07.840541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b5367e0-15a4-435e-a215-0f624b9553b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:07.840973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b5367e0-15a4-435e-a215-0f624b9553b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:07.983884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4b5367e0-15a4-435e-a215-0f624b9553b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:05:07.993672 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4b5367e0-15a4-435e-a215-0f624b9553b7 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 200 len: 1367 microversion: 2.1 time: 0.168838 Jul 04 06:05:07.994248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 683/1371] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:05:07 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:05:08.650203 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ffe8e8af-8c93-40c4-8c8e-f7a1a059113f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:08.651134 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ffe8e8af-8c93-40c4-8c8e-f7a1a059113f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:08.658249 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffe8e8af-8c93-40c4-8c8e-f7a1a059113f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:08.658684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffe8e8af-8c93-40c4-8c8e-f7a1a059113f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:08.659508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffe8e8af-8c93-40c4-8c8e-f7a1a059113f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:08.659945 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffe8e8af-8c93-40c4-8c8e-f7a1a059113f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:08.690507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ffe8e8af-8c93-40c4-8c8e-f7a1a059113f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044173 Jul 04 06:05:08.691102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 689/1372] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:08 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:09.014985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5931add0-b328-4607-8f61-582e529d04d3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:09.016058 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5931add0-b328-4607-8f61-582e529d04d3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:09.029424 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5931add0-b328-4607-8f61-582e529d04d3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:09.030503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5931add0-b328-4607-8f61-582e529d04d3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:09.032721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5931add0-b328-4607-8f61-582e529d04d3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:09.033462 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5931add0-b328-4607-8f61-582e529d04d3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:09.041637 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:09.178433 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5931add0-b328-4607-8f61-582e529d04d3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:05:09.190095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5931add0-b328-4607-8f61-582e529d04d3 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 200 len: 1367 microversion: 2.1 time: 0.181304 Jul 04 06:05:09.190877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 684/1373] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:05:09 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:05:09.705340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-13fce38b-dd13-40a3-aa66-d561aeaa27c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:09.706729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-13fce38b-dd13-40a3-aa66-d561aeaa27c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:09.719766 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13fce38b-dd13-40a3-aa66-d561aeaa27c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:09.720491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13fce38b-dd13-40a3-aa66-d561aeaa27c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:09.721663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13fce38b-dd13-40a3-aa66-d561aeaa27c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:09.722317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13fce38b-dd13-40a3-aa66-d561aeaa27c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:09.757881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-13fce38b-dd13-40a3-aa66-d561aeaa27c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058569 Jul 04 06:05:09.758446 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 690/1374] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:10.207176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1c27385-5df6-46c5-8d86-404f63db1dba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:10.207903 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a1c27385-5df6-46c5-8d86-404f63db1dba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:10.214868 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1c27385-5df6-46c5-8d86-404f63db1dba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:10.215347 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1c27385-5df6-46c5-8d86-404f63db1dba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:10.216112 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1c27385-5df6-46c5-8d86-404f63db1dba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:10.216548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1c27385-5df6-46c5-8d86-404f63db1dba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:10.350930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a1c27385-5df6-46c5-8d86-404f63db1dba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:05:10.360292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a1c27385-5df6-46c5-8d86-404f63db1dba tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 200 len: 1367 microversion: 2.1 time: 0.157062 Jul 04 06:05:10.369572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 685/1375] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:05:10 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:05:10.772429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d980ddba-fe6b-443e-b759-3ab5380b179d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:10.773156 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d980ddba-fe6b-443e-b759-3ab5380b179d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:10.780367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d980ddba-fe6b-443e-b759-3ab5380b179d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:10.780821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d980ddba-fe6b-443e-b759-3ab5380b179d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:10.781577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d980ddba-fe6b-443e-b759-3ab5380b179d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:10.782002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d980ddba-fe6b-443e-b759-3ab5380b179d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:10.813569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d980ddba-fe6b-443e-b759-3ab5380b179d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046699 Jul 04 06:05:10.814118 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 691/1376] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:10 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:11.379522 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7f7d8adf-0674-44df-9337-172fcb35adff tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:11.380875 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7f7d8adf-0674-44df-9337-172fcb35adff tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:11.388551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f7d8adf-0674-44df-9337-172fcb35adff tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:11.389157 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f7d8adf-0674-44df-9337-172fcb35adff tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:11.390044 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f7d8adf-0674-44df-9337-172fcb35adff tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:11.390585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f7d8adf-0674-44df-9337-172fcb35adff tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:11.543902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-6ac40a50-ba2b-4ab0-991c-e4101f4681ad req-b69e53dc-fa32-41ac-b08f-7d52f95c4e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6fb72d-5a19-43fb-9fa5-b630aa555080", "name": "network-vif-plugged", "status": "completed", "tag": "b4adbb43-6f52-4a85-9b6e-f559845cec1e"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:05:11.549487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7f7d8adf-0674-44df-9337-172fcb35adff tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:05:11.552838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6ac40a50-ba2b-4ab0-991c-e4101f4681ad req-b69e53dc-fa32-41ac-b08f-7d52f95c4e29 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:11.553293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6ac40a50-ba2b-4ab0-991c-e4101f4681ad req-b69e53dc-fa32-41ac-b08f-7d52f95c4e29 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:11.559457 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7f7d8adf-0674-44df-9337-172fcb35adff tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 200 len: 1367 microversion: 2.1 time: 0.185371 Jul 04 06:05:11.560457 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 686/1377] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:05:11 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:05:11.565229 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-6ac40a50-ba2b-4ab0-991c-e4101f4681ad req-b69e53dc-fa32-41ac-b08f-7d52f95c4e29 service nova] Creating event network-vif-plugged:b4adbb43-6f52-4a85-9b6e-f559845cec1e for instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 on hv-cinder-79733 Jul 04 06:05:11.571195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-6ac40a50-ba2b-4ab0-991c-e4101f4681ad req-b69e53dc-fa32-41ac-b08f-7d52f95c4e29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030937 Jul 04 06:05:11.571817 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 692/1378] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:05:11.825185 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1163ed32-46b2-40a5-beb8-8c13d78ee192 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:11.826198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1163ed32-46b2-40a5-beb8-8c13d78ee192 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:11.832855 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1163ed32-46b2-40a5-beb8-8c13d78ee192 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:11.833040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1163ed32-46b2-40a5-beb8-8c13d78ee192 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:11.833821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1163ed32-46b2-40a5-beb8-8c13d78ee192 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:11.834259 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1163ed32-46b2-40a5-beb8-8c13d78ee192 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:11.863212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1163ed32-46b2-40a5-beb8-8c13d78ee192 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041927 Jul 04 06:05:11.863735 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 687/1379] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:11 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:12.577954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bc50e502-39d5-4432-8031-e7214ebd09e0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:12.578729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bc50e502-39d5-4432-8031-e7214ebd09e0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:12.585440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc50e502-39d5-4432-8031-e7214ebd09e0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:12.585985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc50e502-39d5-4432-8031-e7214ebd09e0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:12.586831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc50e502-39d5-4432-8031-e7214ebd09e0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:12.587390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc50e502-39d5-4432-8031-e7214ebd09e0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:12.726294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bc50e502-39d5-4432-8031-e7214ebd09e0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:05:12.734144 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bc50e502-39d5-4432-8031-e7214ebd09e0 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 200 len: 1367 microversion: 2.1 time: 0.161005 Jul 04 06:05:12.734774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 693/1380] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:05:12 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:05:12.878065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3dbaf72c-46c7-4aaf-b694-b2928096adcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:12.879521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3dbaf72c-46c7-4aaf-b694-b2928096adcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:12.886673 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dbaf72c-46c7-4aaf-b694-b2928096adcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:12.887124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dbaf72c-46c7-4aaf-b694-b2928096adcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:12.887954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dbaf72c-46c7-4aaf-b694-b2928096adcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:12.888359 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dbaf72c-46c7-4aaf-b694-b2928096adcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:12.918427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3dbaf72c-46c7-4aaf-b694-b2928096adcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047100 Jul 04 06:05:12.918997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 688/1381] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:12 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:13.754315 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3f3386ab-5d2b-4816-a390-fc9f16845146 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:13.755168 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3f3386ab-5d2b-4816-a390-fc9f16845146 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:13.766189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f3386ab-5d2b-4816-a390-fc9f16845146 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:13.766942 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f3386ab-5d2b-4816-a390-fc9f16845146 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:13.768206 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f3386ab-5d2b-4816-a390-fc9f16845146 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:13.768907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f3386ab-5d2b-4816-a390-fc9f16845146 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:13.911778 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3f3386ab-5d2b-4816-a390-fc9f16845146 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:05:13.919662 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3f3386ab-5d2b-4816-a390-fc9f16845146 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 200 len: 1556 microversion: 2.1 time: 0.172084 Jul 04 06:05:13.920840 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 694/1382] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:05:13 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:05:13.929946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f8b7c4b2-7696-4176-b12e-fca371df5bfa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:13.931015 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f8b7c4b2-7696-4176-b12e-fca371df5bfa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:13.935833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c7056667-3df9-41ac-8d0d-fef937453db2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:13.936327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c7056667-3df9-41ac-8d0d-fef937453db2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:13.937976 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8b7c4b2-7696-4176-b12e-fca371df5bfa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:13.938493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8b7c4b2-7696-4176-b12e-fca371df5bfa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:13.939510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8b7c4b2-7696-4176-b12e-fca371df5bfa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:13.939921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8b7c4b2-7696-4176-b12e-fca371df5bfa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:13.942423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7056667-3df9-41ac-8d0d-fef937453db2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:13.942859 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7056667-3df9-41ac-8d0d-fef937453db2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:13.943707 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7056667-3df9-41ac-8d0d-fef937453db2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:13.944597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7056667-3df9-41ac-8d0d-fef937453db2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:13.970590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f8b7c4b2-7696-4176-b12e-fca371df5bfa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044568 Jul 04 06:05:13.971434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 689/1383] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:13 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:14.020607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c7056667-3df9-41ac-8d0d-fef937453db2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088498 Jul 04 06:05:14.021241 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 695/1384] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jul 4 06:05:13 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:14.981982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fdc735ec-366c-4962-84f2-3062e9eac555 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:14.982911 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fdc735ec-366c-4962-84f2-3062e9eac555 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:14.984856 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:14.985935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=12 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:15.004113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc735ec-366c-4962-84f2-3062e9eac555 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:15.004555 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc735ec-366c-4962-84f2-3062e9eac555 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:15.005199 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-5a65f628-f4dd-4d83-ade7-7c2ab1b9db67 req-e19cca84-93b8-4623-b830-ad08bcea007e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6fb72d-5a19-43fb-9fa5-b630aa555080", "tag": "b4adbb43-6f52-4a85-9b6e-f559845cec1e"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:05:15.005734 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc735ec-366c-4962-84f2-3062e9eac555 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:15.005838 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc735ec-366c-4962-84f2-3062e9eac555 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:15.018303 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-5a65f628-f4dd-4d83-ade7-7c2ab1b9db67 req-e19cca84-93b8-4623-b830-ad08bcea007e service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:15.018746 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-5a65f628-f4dd-4d83-ade7-7c2ab1b9db67 req-e19cca84-93b8-4623-b830-ad08bcea007e service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:15.046991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-5a65f628-f4dd-4d83-ade7-7c2ab1b9db67 req-e19cca84-93b8-4623-b830-ad08bcea007e service nova] Creating event network-changed:b4adbb43-6f52-4a85-9b6e-f559845cec1e for instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 on hv-cinder-79733 Jul 04 06:05:15.049807 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fdc735ec-366c-4962-84f2-3062e9eac555 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071600 Jul 04 06:05:15.051544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 690/1385] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:14 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:15.055400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-5a65f628-f4dd-4d83-ade7-7c2ab1b9db67 req-e19cca84-93b8-4623-b830-ad08bcea007e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054352 Jul 04 06:05:15.056174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 696/1386] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:16.061446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1cd66e30-0a1d-4b3a-a9fa-86e076868863 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:16.062668 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1cd66e30-0a1d-4b3a-a9fa-86e076868863 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:16.069871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd66e30-0a1d-4b3a-a9fa-86e076868863 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:16.070666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd66e30-0a1d-4b3a-a9fa-86e076868863 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:16.071495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd66e30-0a1d-4b3a-a9fa-86e076868863 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:16.071932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd66e30-0a1d-4b3a-a9fa-86e076868863 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:16.104541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1cd66e30-0a1d-4b3a-a9fa-86e076868863 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046966 Jul 04 06:05:16.104995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 691/1387] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:17.117074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ff11bcec-ff40-4d5c-8c57-4109f1a4fd45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:17.118083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ff11bcec-ff40-4d5c-8c57-4109f1a4fd45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:17.124814 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff11bcec-ff40-4d5c-8c57-4109f1a4fd45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:17.125261 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff11bcec-ff40-4d5c-8c57-4109f1a4fd45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:17.125999 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff11bcec-ff40-4d5c-8c57-4109f1a4fd45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:17.126799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff11bcec-ff40-4d5c-8c57-4109f1a4fd45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:17.155856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ff11bcec-ff40-4d5c-8c57-4109f1a4fd45 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043991 Jul 04 06:05:17.156411 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 697/1388] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:18.168411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0ff48cc8-4423-41cc-962b-6d999bd4f687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:18.169341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0ff48cc8-4423-41cc-962b-6d999bd4f687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:18.176053 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ff48cc8-4423-41cc-962b-6d999bd4f687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:18.176510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ff48cc8-4423-41cc-962b-6d999bd4f687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:18.177282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ff48cc8-4423-41cc-962b-6d999bd4f687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:18.177736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ff48cc8-4423-41cc-962b-6d999bd4f687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:18.206982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0ff48cc8-4423-41cc-962b-6d999bd4f687 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042591 Jul 04 06:05:18.207613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 692/1389] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:19.219204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d84cb9ef-bc0d-4878-963e-dc5dbf72de2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:19.220314 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d84cb9ef-bc0d-4878-963e-dc5dbf72de2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:19.227705 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d84cb9ef-bc0d-4878-963e-dc5dbf72de2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:19.228240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d84cb9ef-bc0d-4878-963e-dc5dbf72de2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:19.229131 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d84cb9ef-bc0d-4878-963e-dc5dbf72de2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:19.229637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d84cb9ef-bc0d-4878-963e-dc5dbf72de2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:19.261387 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d84cb9ef-bc0d-4878-963e-dc5dbf72de2b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046924 Jul 04 06:05:19.261942 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 698/1390] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:20.273797 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fb8819a8-36be-4664-8c2d-76f5a78a8f28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:20.274834 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fb8819a8-36be-4664-8c2d-76f5a78a8f28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:20.282103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb8819a8-36be-4664-8c2d-76f5a78a8f28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:20.282607 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb8819a8-36be-4664-8c2d-76f5a78a8f28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:20.283502 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb8819a8-36be-4664-8c2d-76f5a78a8f28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:20.283987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb8819a8-36be-4664-8c2d-76f5a78a8f28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:20.313625 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fb8819a8-36be-4664-8c2d-76f5a78a8f28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Jul 04 06:05:20.314198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 693/1391] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:20 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:21.329313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-395c674f-86c0-4ad6-9c0f-50ee71560f21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:21.331025 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-395c674f-86c0-4ad6-9c0f-50ee71560f21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:21.339344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-395c674f-86c0-4ad6-9c0f-50ee71560f21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:21.339797 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-395c674f-86c0-4ad6-9c0f-50ee71560f21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:21.340563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-395c674f-86c0-4ad6-9c0f-50ee71560f21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:21.340996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-395c674f-86c0-4ad6-9c0f-50ee71560f21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:21.371096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-395c674f-86c0-4ad6-9c0f-50ee71560f21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048460 Jul 04 06:05:21.371683 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 699/1392] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:22.382080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9addee12-1cd2-4bd4-a027-bb85cf90402f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:22.383071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9addee12-1cd2-4bd4-a027-bb85cf90402f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:22.389667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9addee12-1cd2-4bd4-a027-bb85cf90402f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:22.390114 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9addee12-1cd2-4bd4-a027-bb85cf90402f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:22.390852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9addee12-1cd2-4bd4-a027-bb85cf90402f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:22.391521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9addee12-1cd2-4bd4-a027-bb85cf90402f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:22.423820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9addee12-1cd2-4bd4-a027-bb85cf90402f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045607 Jul 04 06:05:22.424350 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 694/1393] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:23.439753 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4b4a2e28-5e3d-48dc-9153-6f30176d96aa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:23.441280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4b4a2e28-5e3d-48dc-9153-6f30176d96aa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:23.452284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b4a2e28-5e3d-48dc-9153-6f30176d96aa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:23.453063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b4a2e28-5e3d-48dc-9153-6f30176d96aa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:23.454333 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b4a2e28-5e3d-48dc-9153-6f30176d96aa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:23.455061 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b4a2e28-5e3d-48dc-9153-6f30176d96aa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:23.488964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4b4a2e28-5e3d-48dc-9153-6f30176d96aa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055674 Jul 04 06:05:23.489522 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 700/1394] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:24.500742 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-39cbaba7-829a-40c1-b57d-081b5a33190f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:24.501811 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-39cbaba7-829a-40c1-b57d-081b5a33190f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:24.508424 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39cbaba7-829a-40c1-b57d-081b5a33190f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:24.508897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39cbaba7-829a-40c1-b57d-081b5a33190f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:24.509633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39cbaba7-829a-40c1-b57d-081b5a33190f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:24.510179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39cbaba7-829a-40c1-b57d-081b5a33190f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:24.542379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-39cbaba7-829a-40c1-b57d-081b5a33190f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Jul 04 06:05:24.542948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 695/1395] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:25.554892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cc0d3f48-4376-4ced-81ab-2cb660489e43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:25.555835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cc0d3f48-4376-4ced-81ab-2cb660489e43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:25.558672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:25.566287 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc0d3f48-4376-4ced-81ab-2cb660489e43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:25.566893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc0d3f48-4376-4ced-81ab-2cb660489e43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:25.568070 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc0d3f48-4376-4ced-81ab-2cb660489e43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:25.568821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc0d3f48-4376-4ced-81ab-2cb660489e43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:25.601121 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cc0d3f48-4376-4ced-81ab-2cb660489e43 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050239 Jul 04 06:05:25.601767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 701/1396] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:26.612699 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db3b2e9a-9072-42b5-bc97-ce8a22b88c9d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:26.613618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db3b2e9a-9072-42b5-bc97-ce8a22b88c9d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:26.620760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db3b2e9a-9072-42b5-bc97-ce8a22b88c9d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:26.621059 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db3b2e9a-9072-42b5-bc97-ce8a22b88c9d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:26.621856 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db3b2e9a-9072-42b5-bc97-ce8a22b88c9d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:26.622298 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db3b2e9a-9072-42b5-bc97-ce8a22b88c9d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:26.652256 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db3b2e9a-9072-42b5-bc97-ce8a22b88c9d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043476 Jul 04 06:05:26.652818 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 696/1397] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:27.664325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d6f2254f-ebd2-40d7-ab48-35234ecfdb9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:27.665256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d6f2254f-ebd2-40d7-ab48-35234ecfdb9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:27.672247 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6f2254f-ebd2-40d7-ab48-35234ecfdb9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:27.672701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6f2254f-ebd2-40d7-ab48-35234ecfdb9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:27.673476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6f2254f-ebd2-40d7-ab48-35234ecfdb9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:27.673910 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6f2254f-ebd2-40d7-ab48-35234ecfdb9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:27.698326 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:27.704773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d6f2254f-ebd2-40d7-ab48-35234ecfdb9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044415 Jul 04 06:05:27.705340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 702/1398] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:28.716914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3f3fcdfe-afc4-4d5e-bef0-da57370a4186 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:28.717956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3f3fcdfe-afc4-4d5e-bef0-da57370a4186 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:28.724808 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f3fcdfe-afc4-4d5e-bef0-da57370a4186 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:28.725364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f3fcdfe-afc4-4d5e-bef0-da57370a4186 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:28.726060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f3fcdfe-afc4-4d5e-bef0-da57370a4186 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:28.726526 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f3fcdfe-afc4-4d5e-bef0-da57370a4186 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:28.759466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3f3fcdfe-afc4-4d5e-bef0-da57370a4186 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046627 Jul 04 06:05:28.759941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 697/1399] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:29.770108 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b6eec9c-bdb9-4be1-93ed-5c6530e27fa7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:29.771037 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6b6eec9c-bdb9-4be1-93ed-5c6530e27fa7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:29.777935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b6eec9c-bdb9-4be1-93ed-5c6530e27fa7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:29.778387 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b6eec9c-bdb9-4be1-93ed-5c6530e27fa7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:29.779161 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b6eec9c-bdb9-4be1-93ed-5c6530e27fa7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:29.780036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b6eec9c-bdb9-4be1-93ed-5c6530e27fa7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:29.809861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6b6eec9c-bdb9-4be1-93ed-5c6530e27fa7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Jul 04 06:05:29.810447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 703/1400] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:30.822771 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-81a50117-d073-47ea-8e5c-404bea972cd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:30.823923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-81a50117-d073-47ea-8e5c-404bea972cd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:30.826348 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:30.832268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81a50117-d073-47ea-8e5c-404bea972cd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:30.832730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81a50117-d073-47ea-8e5c-404bea972cd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:30.833501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81a50117-d073-47ea-8e5c-404bea972cd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:30.833936 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81a50117-d073-47ea-8e5c-404bea972cd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:30.864682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-81a50117-d073-47ea-8e5c-404bea972cd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Jul 04 06:05:30.865236 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 698/1401] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:30 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:31.878299 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-db0bd6e9-1c96-413e-bb25-5395fc8a7fd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:31.879230 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-db0bd6e9-1c96-413e-bb25-5395fc8a7fd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:31.886168 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db0bd6e9-1c96-413e-bb25-5395fc8a7fd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:31.886613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db0bd6e9-1c96-413e-bb25-5395fc8a7fd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:31.887395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db0bd6e9-1c96-413e-bb25-5395fc8a7fd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:31.887841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db0bd6e9-1c96-413e-bb25-5395fc8a7fd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:31.918665 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-db0bd6e9-1c96-413e-bb25-5395fc8a7fd0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044358 Jul 04 06:05:31.919279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 704/1402] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:31 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:32.930972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ffc48d0f-da66-4f41-808a-a46b44c51670 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:32.932012 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ffc48d0f-da66-4f41-808a-a46b44c51670 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:32.938899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffc48d0f-da66-4f41-808a-a46b44c51670 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:32.939292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffc48d0f-da66-4f41-808a-a46b44c51670 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:32.940112 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffc48d0f-da66-4f41-808a-a46b44c51670 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:32.940548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffc48d0f-da66-4f41-808a-a46b44c51670 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:32.970289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ffc48d0f-da66-4f41-808a-a46b44c51670 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Jul 04 06:05:32.970911 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 699/1403] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:32 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:33.988072 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b8334669-1dea-424e-a0b3-995b50245b2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:33.989641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b8334669-1dea-424e-a0b3-995b50245b2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:33.998507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8334669-1dea-424e-a0b3-995b50245b2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:33.999145 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8334669-1dea-424e-a0b3-995b50245b2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:33.999934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8334669-1dea-424e-a0b3-995b50245b2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:34.000364 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8334669-1dea-424e-a0b3-995b50245b2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:34.029818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b8334669-1dea-424e-a0b3-995b50245b2a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048214 Jul 04 06:05:34.030507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 705/1404] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:35.113183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e499f4d7-64f0-42cf-ae58-82d4eccff3e7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:35.114113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e499f4d7-64f0-42cf-ae58-82d4eccff3e7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:35.120287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e499f4d7-64f0-42cf-ae58-82d4eccff3e7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:35.120732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e499f4d7-64f0-42cf-ae58-82d4eccff3e7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:35.121502 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e499f4d7-64f0-42cf-ae58-82d4eccff3e7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:35.121937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e499f4d7-64f0-42cf-ae58-82d4eccff3e7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:35.146623 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:35.151237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e499f4d7-64f0-42cf-ae58-82d4eccff3e7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112356 Jul 04 06:05:35.151833 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 700/1405] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:36.163035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-298f88ba-0a88-4c5a-a081-ae7a0bfb866f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:36.164029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-298f88ba-0a88-4c5a-a081-ae7a0bfb866f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:36.170956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-298f88ba-0a88-4c5a-a081-ae7a0bfb866f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:36.171454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-298f88ba-0a88-4c5a-a081-ae7a0bfb866f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:36.172215 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-298f88ba-0a88-4c5a-a081-ae7a0bfb866f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:36.172615 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-298f88ba-0a88-4c5a-a081-ae7a0bfb866f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:36.203257 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-298f88ba-0a88-4c5a-a081-ae7a0bfb866f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044045 Jul 04 06:05:36.203851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 706/1406] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:37.215504 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61a56146-bf19-4ed7-be55-283101f8d5ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:37.218549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61a56146-bf19-4ed7-be55-283101f8d5ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:37.225560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61a56146-bf19-4ed7-be55-283101f8d5ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:37.226057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61a56146-bf19-4ed7-be55-283101f8d5ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:37.226942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61a56146-bf19-4ed7-be55-283101f8d5ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:37.227437 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61a56146-bf19-4ed7-be55-283101f8d5ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:37.257461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61a56146-bf19-4ed7-be55-283101f8d5ac tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046402 Jul 04 06:05:37.258019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 701/1407] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:38.269436 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d573e191-24b9-4f01-9ef2-7b61a305a6c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:38.270397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d573e191-24b9-4f01-9ef2-7b61a305a6c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:38.277109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d573e191-24b9-4f01-9ef2-7b61a305a6c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:38.277557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d573e191-24b9-4f01-9ef2-7b61a305a6c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:38.278313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d573e191-24b9-4f01-9ef2-7b61a305a6c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:38.278749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d573e191-24b9-4f01-9ef2-7b61a305a6c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:38.308270 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d573e191-24b9-4f01-9ef2-7b61a305a6c9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042874 Jul 04 06:05:38.308795 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 707/1408] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:39.320873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c476faec-a2f4-4800-986c-1535e48babc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:39.322301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c476faec-a2f4-4800-986c-1535e48babc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:39.332660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c476faec-a2f4-4800-986c-1535e48babc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:39.333379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c476faec-a2f4-4800-986c-1535e48babc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:39.334606 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c476faec-a2f4-4800-986c-1535e48babc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:39.335435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c476faec-a2f4-4800-986c-1535e48babc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:39.365180 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c476faec-a2f4-4800-986c-1535e48babc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049873 Jul 04 06:05:39.365693 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 702/1409] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:40.377139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-16d7f6b3-906a-40e0-81f9-9714b85e74f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:40.378074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-16d7f6b3-906a-40e0-81f9-9714b85e74f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:40.384924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16d7f6b3-906a-40e0-81f9-9714b85e74f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:40.385381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16d7f6b3-906a-40e0-81f9-9714b85e74f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:40.386279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16d7f6b3-906a-40e0-81f9-9714b85e74f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:40.386715 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16d7f6b3-906a-40e0-81f9-9714b85e74f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:40.416481 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-16d7f6b3-906a-40e0-81f9-9714b85e74f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043425 Jul 04 06:05:40.417030 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 708/1410] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:41.428800 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6f3a067e-409d-4216-98e4-186d2dfe99a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:41.429527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6f3a067e-409d-4216-98e4-186d2dfe99a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:41.436334 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f3a067e-409d-4216-98e4-186d2dfe99a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:41.436778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f3a067e-409d-4216-98e4-186d2dfe99a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:41.437575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f3a067e-409d-4216-98e4-186d2dfe99a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:41.438002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f3a067e-409d-4216-98e4-186d2dfe99a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:41.467741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6f3a067e-409d-4216-98e4-186d2dfe99a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042943 Jul 04 06:05:41.468347 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 703/1411] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:41 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:42.480354 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-daf33460-d2fc-4d86-8cd7-e34e26ce283f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:42.481529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-daf33460-d2fc-4d86-8cd7-e34e26ce283f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:42.488445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daf33460-d2fc-4d86-8cd7-e34e26ce283f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:42.488826 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daf33460-d2fc-4d86-8cd7-e34e26ce283f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:42.489586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daf33460-d2fc-4d86-8cd7-e34e26ce283f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:42.490023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daf33460-d2fc-4d86-8cd7-e34e26ce283f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:42.519789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-daf33460-d2fc-4d86-8cd7-e34e26ce283f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043761 Jul 04 06:05:42.520359 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 709/1412] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:42 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:43.531743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a316dded-5e65-48b4-814b-1bee06b4d737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:43.532839 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a316dded-5e65-48b4-814b-1bee06b4d737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:43.539641 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a316dded-5e65-48b4-814b-1bee06b4d737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:43.540094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a316dded-5e65-48b4-814b-1bee06b4d737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:43.540871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a316dded-5e65-48b4-814b-1bee06b4d737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:43.541306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a316dded-5e65-48b4-814b-1bee06b4d737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:43.570932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a316dded-5e65-48b4-814b-1bee06b4d737 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043852 Jul 04 06:05:43.571424 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 704/1413] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:44.582475 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-079c0c64-b9dd-44ed-9a68-d011fcc16d89 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:44.583425 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-079c0c64-b9dd-44ed-9a68-d011fcc16d89 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:44.590125 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-079c0c64-b9dd-44ed-9a68-d011fcc16d89 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:44.590559 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-079c0c64-b9dd-44ed-9a68-d011fcc16d89 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:44.591339 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-079c0c64-b9dd-44ed-9a68-d011fcc16d89 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:44.591807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-079c0c64-b9dd-44ed-9a68-d011fcc16d89 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:44.621205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-079c0c64-b9dd-44ed-9a68-d011fcc16d89 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042848 Jul 04 06:05:44.621751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 710/1414] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:44 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:45.636751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8faa6acc-be84-4d11-b3f1-9d3a15956ea5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:45.638012 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8faa6acc-be84-4d11-b3f1-9d3a15956ea5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:45.645215 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8faa6acc-be84-4d11-b3f1-9d3a15956ea5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:45.645680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8faa6acc-be84-4d11-b3f1-9d3a15956ea5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:45.646446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8faa6acc-be84-4d11-b3f1-9d3a15956ea5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:45.646885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8faa6acc-be84-4d11-b3f1-9d3a15956ea5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:45.676825 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8faa6acc-be84-4d11-b3f1-9d3a15956ea5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046476 Jul 04 06:05:45.677321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 705/1415] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:46.690055 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-27456f65-1482-4102-96a5-214f1339a9e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:46.691164 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-27456f65-1482-4102-96a5-214f1339a9e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:46.697938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27456f65-1482-4102-96a5-214f1339a9e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:46.698404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27456f65-1482-4102-96a5-214f1339a9e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:46.699142 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27456f65-1482-4102-96a5-214f1339a9e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:46.699601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27456f65-1482-4102-96a5-214f1339a9e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:46.729473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-27456f65-1482-4102-96a5-214f1339a9e2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043608 Jul 04 06:05:46.730020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 711/1416] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:46 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:47.741080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1e2a9f7-1bbc-4de2-a89f-ec639f64d732 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:47.742007 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a1e2a9f7-1bbc-4de2-a89f-ec639f64d732 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:47.748914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1e2a9f7-1bbc-4de2-a89f-ec639f64d732 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:47.749431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1e2a9f7-1bbc-4de2-a89f-ec639f64d732 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:47.750123 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1e2a9f7-1bbc-4de2-a89f-ec639f64d732 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:47.750557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1e2a9f7-1bbc-4de2-a89f-ec639f64d732 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:47.781333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a1e2a9f7-1bbc-4de2-a89f-ec639f64d732 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044292 Jul 04 06:05:47.781884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 706/1417] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:48.793089 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3bb0f1a0-0de0-48d3-bd53-4560575ae268 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:48.794023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3bb0f1a0-0de0-48d3-bd53-4560575ae268 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:48.800512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bb0f1a0-0de0-48d3-bd53-4560575ae268 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:48.801073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bb0f1a0-0de0-48d3-bd53-4560575ae268 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:48.801838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bb0f1a0-0de0-48d3-bd53-4560575ae268 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:48.802265 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bb0f1a0-0de0-48d3-bd53-4560575ae268 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:48.832319 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3bb0f1a0-0de0-48d3-bd53-4560575ae268 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043256 Jul 04 06:05:48.832871 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 712/1418] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:49.842686 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf87b93e-ea63-4525-b239-87e0cf785e77 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:49.843182 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bf87b93e-ea63-4525-b239-87e0cf785e77 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:49.843676 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3fecaa24-1798-4492-90a6-83891c0668de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:49.844688 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3fecaa24-1798-4492-90a6-83891c0668de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:49.849712 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf87b93e-ea63-4525-b239-87e0cf785e77 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:49.850394 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf87b93e-ea63-4525-b239-87e0cf785e77 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:49.851174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf87b93e-ea63-4525-b239-87e0cf785e77 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:49.851341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fecaa24-1798-4492-90a6-83891c0668de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:49.851633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf87b93e-ea63-4525-b239-87e0cf785e77 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:49.851989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fecaa24-1798-4492-90a6-83891c0668de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:49.852762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fecaa24-1798-4492-90a6-83891c0668de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:49.853199 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fecaa24-1798-4492-90a6-83891c0668de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:49.881382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf87b93e-ea63-4525-b239-87e0cf785e77 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080/ips" status: 200 len: 149 microversion: 2.1 time: 0.042927 Jul 04 06:05:49.881946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 707/1419] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jul 4 06:05:49 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:49.882604 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3fecaa24-1798-4492-90a6-83891c0668de tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042899 Jul 04 06:05:49.883188 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 713/1420] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:50.895058 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3bbbfc37-4dd9-4795-91b5-e414ea1e2ef2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:50.896059 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3bbbfc37-4dd9-4795-91b5-e414ea1e2ef2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:50.902970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bbbfc37-4dd9-4795-91b5-e414ea1e2ef2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:50.903464 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bbbfc37-4dd9-4795-91b5-e414ea1e2ef2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:50.906424 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bbbfc37-4dd9-4795-91b5-e414ea1e2ef2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:50.906424 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bbbfc37-4dd9-4795-91b5-e414ea1e2ef2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:50.937996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3bbbfc37-4dd9-4795-91b5-e414ea1e2ef2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046905 Jul 04 06:05:50.938766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 708/1421] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:50 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:51.809857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:05:51.809857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:05:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:05:51.949478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-436d05c4-4a38-41c1-82b5-bb9360af6a32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:51.950407 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-436d05c4-4a38-41c1-82b5-bb9360af6a32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:51.956998 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-436d05c4-4a38-41c1-82b5-bb9360af6a32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:51.957450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-436d05c4-4a38-41c1-82b5-bb9360af6a32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:51.958210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-436d05c4-4a38-41c1-82b5-bb9360af6a32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:51.958644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-436d05c4-4a38-41c1-82b5-bb9360af6a32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:51.988398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-436d05c4-4a38-41c1-82b5-bb9360af6a32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042802 Jul 04 06:05:51.988916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 714/1422] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:51 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:53.000867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f8f53290-2fe9-41ef-af87-fcbe19c4940a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:53.001801 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f8f53290-2fe9-41ef-af87-fcbe19c4940a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:53.008213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8f53290-2fe9-41ef-af87-fcbe19c4940a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:53.008663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8f53290-2fe9-41ef-af87-fcbe19c4940a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:53.009447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8f53290-2fe9-41ef-af87-fcbe19c4940a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:53.009884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8f53290-2fe9-41ef-af87-fcbe19c4940a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:53.040633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f8f53290-2fe9-41ef-af87-fcbe19c4940a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043870 Jul 04 06:05:53.041227 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 709/1423] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:52 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:54.052356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3e42b691-c2d1-443d-8551-3d1dba091f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:54.053285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3e42b691-c2d1-443d-8551-3d1dba091f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:54.059938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e42b691-c2d1-443d-8551-3d1dba091f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:54.060389 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e42b691-c2d1-443d-8551-3d1dba091f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:54.061155 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e42b691-c2d1-443d-8551-3d1dba091f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:54.061574 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e42b691-c2d1-443d-8551-3d1dba091f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:54.090740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3e42b691-c2d1-443d-8551-3d1dba091f14 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 Jul 04 06:05:54.091313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 715/1424] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:55.102083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4eb12bf5-e58d-4827-b3a9-834bcde10057 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:55.103017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4eb12bf5-e58d-4827-b3a9-834bcde10057 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:55.109922 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eb12bf5-e58d-4827-b3a9-834bcde10057 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:55.110379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eb12bf5-e58d-4827-b3a9-834bcde10057 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:55.111155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eb12bf5-e58d-4827-b3a9-834bcde10057 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:55.111627 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eb12bf5-e58d-4827-b3a9-834bcde10057 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:55.142045 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4eb12bf5-e58d-4827-b3a9-834bcde10057 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043888 Jul 04 06:05:55.142651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 710/1425] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:56.153838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-12be211a-313e-4867-b97c-6430a3575399 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:56.156229 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-12be211a-313e-4867-b97c-6430a3575399 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:56.160548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=30 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:56.165452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12be211a-313e-4867-b97c-6430a3575399 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:56.165899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12be211a-313e-4867-b97c-6430a3575399 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:56.166831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12be211a-313e-4867-b97c-6430a3575399 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:56.167280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12be211a-313e-4867-b97c-6430a3575399 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:56.207210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-12be211a-313e-4867-b97c-6430a3575399 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057317 Jul 04 06:05:56.207795 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 716/1426] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:56 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:57.218206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75e8e6b5-bfba-4a2c-a960-a91e085d0e9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:57.219321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-75e8e6b5-bfba-4a2c-a960-a91e085d0e9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:57.225794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75e8e6b5-bfba-4a2c-a960-a91e085d0e9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:57.226251 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75e8e6b5-bfba-4a2c-a960-a91e085d0e9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:57.227039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75e8e6b5-bfba-4a2c-a960-a91e085d0e9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:57.227525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75e8e6b5-bfba-4a2c-a960-a91e085d0e9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:57.261496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-75e8e6b5-bfba-4a2c-a960-a91e085d0e9f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047112 Jul 04 06:05:57.262115 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 711/1427] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:57 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:58.273576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a6eb2e94-0b3b-427b-a432-b0d6e5cb3c3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:58.274382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a6eb2e94-0b3b-427b-a432-b0d6e5cb3c3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:58.281816 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6eb2e94-0b3b-427b-a432-b0d6e5cb3c3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:58.282263 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6eb2e94-0b3b-427b-a432-b0d6e5cb3c3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:58.283031 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6eb2e94-0b3b-427b-a432-b0d6e5cb3c3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:58.283502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6eb2e94-0b3b-427b-a432-b0d6e5cb3c3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:58.312450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a6eb2e94-0b3b-427b-a432-b0d6e5cb3c3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042994 Jul 04 06:05:58.313051 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 717/1428] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:05:59.324203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0af141e8-0b68-45d7-8655-467c4d9cd4b1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:05:59.325773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0af141e8-0b68-45d7-8655-467c4d9cd4b1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:05:59.332227 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0af141e8-0b68-45d7-8655-467c4d9cd4b1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:59.332710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0af141e8-0b68-45d7-8655-467c4d9cd4b1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:59.333481 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0af141e8-0b68-45d7-8655-467c4d9cd4b1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:05:59.333912 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0af141e8-0b68-45d7-8655-467c4d9cd4b1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:05:59.371919 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0af141e8-0b68-45d7-8655-467c4d9cd4b1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051609 Jul 04 06:05:59.372567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 712/1429] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:05:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:00.383801 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b05dd225-42ed-4a67-93b9-b1f276ee8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:00.384730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b05dd225-42ed-4a67-93b9-b1f276ee8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:00.391608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b05dd225-42ed-4a67-93b9-b1f276ee8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:00.392061 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b05dd225-42ed-4a67-93b9-b1f276ee8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:00.392827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b05dd225-42ed-4a67-93b9-b1f276ee8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:00.393264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b05dd225-42ed-4a67-93b9-b1f276ee8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:00.395990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=92 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:00.424554 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b05dd225-42ed-4a67-93b9-b1f276ee8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Jul 04 06:06:00.425128 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 718/1430] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:00 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:01.436192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff3d90a5-d29d-4579-9b2e-b496493ec5b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:01.437235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff3d90a5-d29d-4579-9b2e-b496493ec5b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:01.440812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=30 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:01.444526 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff3d90a5-d29d-4579-9b2e-b496493ec5b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:01.444970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff3d90a5-d29d-4579-9b2e-b496493ec5b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:01.445725 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff3d90a5-d29d-4579-9b2e-b496493ec5b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:01.446180 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff3d90a5-d29d-4579-9b2e-b496493ec5b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:01.476171 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff3d90a5-d29d-4579-9b2e-b496493ec5b7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043852 Jul 04 06:06:01.476744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 713/1431] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:01 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:02.487397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1235394b-3bcf-46aa-b4a7-35da3783155d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:02.488326 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1235394b-3bcf-46aa-b4a7-35da3783155d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:02.495746 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1235394b-3bcf-46aa-b4a7-35da3783155d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:02.496370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1235394b-3bcf-46aa-b4a7-35da3783155d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:02.497418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1235394b-3bcf-46aa-b4a7-35da3783155d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:02.497843 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1235394b-3bcf-46aa-b4a7-35da3783155d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:02.531045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1235394b-3bcf-46aa-b4a7-35da3783155d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047522 Jul 04 06:06:02.531618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 719/1432] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:02 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:03.544795 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f281bfb0-12f5-49ae-9134-a163bf70e5e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:03.547585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f281bfb0-12f5-49ae-9134-a163bf70e5e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:03.562671 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f281bfb0-12f5-49ae-9134-a163bf70e5e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:03.563136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f281bfb0-12f5-49ae-9134-a163bf70e5e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:03.563945 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f281bfb0-12f5-49ae-9134-a163bf70e5e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:03.564381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f281bfb0-12f5-49ae-9134-a163bf70e5e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:03.595083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f281bfb0-12f5-49ae-9134-a163bf70e5e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055183 Jul 04 06:06:03.595789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 714/1433] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:04.606057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-98bff029-1840-411c-a735-4d6d1ea0d185 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:04.608479 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-98bff029-1840-411c-a735-4d6d1ea0d185 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:04.615109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98bff029-1840-411c-a735-4d6d1ea0d185 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:04.615585 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98bff029-1840-411c-a735-4d6d1ea0d185 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:04.616353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98bff029-1840-411c-a735-4d6d1ea0d185 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:04.616785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98bff029-1840-411c-a735-4d6d1ea0d185 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:04.646278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-98bff029-1840-411c-a735-4d6d1ea0d185 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Jul 04 06:06:04.646845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 720/1434] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:04.721192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-773220ec-164a-4173-920b-9259b09948ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:04.721741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-773220ec-164a-4173-920b-9259b09948ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:04.728126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-773220ec-164a-4173-920b-9259b09948ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:04.728618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-773220ec-164a-4173-920b-9259b09948ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:04.729398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-773220ec-164a-4173-920b-9259b09948ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:04.729836 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-773220ec-164a-4173-920b-9259b09948ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:04.755004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-773220ec-164a-4173-920b-9259b09948ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:06:04.817670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR oslo.messaging._drivers.impl_rabbit [None req-773220ec-164a-4173-920b-9259b09948ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [3637d322-2379-4a2c-ba8a-c74a27d9b494] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 04 06:06:05.658146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cddfa3a7-eab3-49f1-a8b5-d0678b157882 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:05.659069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cddfa3a7-eab3-49f1-a8b5-d0678b157882 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:05.665690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cddfa3a7-eab3-49f1-a8b5-d0678b157882 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:05.666139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cddfa3a7-eab3-49f1-a8b5-d0678b157882 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:05.666905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cddfa3a7-eab3-49f1-a8b5-d0678b157882 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:05.667357 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cddfa3a7-eab3-49f1-a8b5-d0678b157882 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:05.705290 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cddfa3a7-eab3-49f1-a8b5-d0678b157882 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051425 Jul 04 06:06:05.705865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 721/1435] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:05 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:05.826539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [None req-773220ec-164a-4173-920b-9259b09948ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [3637d322-2379-4a2c-ba8a-c74a27d9b494] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 54810. Jul 04 06:06:05.852246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-773220ec-164a-4173-920b-9259b09948ff tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 204 len: 0 microversion: 2.20 time: 1.135069 Jul 04 06:06:05.852870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 715/1436] 10.222.0.42 () {60 vars in 1279 bytes} [Mon Jul 4 06:06:04 2022] DELETE /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 0 bytes in 1136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 06:06:05.861631 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1436d67a-1939-41a4-883b-99018eb64332 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:05.862229 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1436d67a-1939-41a4-883b-99018eb64332 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:05.868442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1436d67a-1939-41a4-883b-99018eb64332 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:05.868908 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1436d67a-1939-41a4-883b-99018eb64332 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:05.869680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1436d67a-1939-41a4-883b-99018eb64332 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:05.870116 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1436d67a-1939-41a4-883b-99018eb64332 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:06.011591 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1436d67a-1939-41a4-883b-99018eb64332 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:06:06.019951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1436d67a-1939-41a4-883b-99018eb64332 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:06:06.021444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1436d67a-1939-41a4-883b-99018eb64332 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:06:06.022600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1436d67a-1939-41a4-883b-99018eb64332 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1721 microversion: 2.20 time: 0.165299 Jul 04 06:06:06.023157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 722/1437] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 06:06:05 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 06:06:06.717215 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-96391122-b091-4c8c-8508-639b33917781 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:06.718255 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-96391122-b091-4c8c-8508-639b33917781 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:06.726929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96391122-b091-4c8c-8508-639b33917781 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:06.727393 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96391122-b091-4c8c-8508-639b33917781 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:06.728144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96391122-b091-4c8c-8508-639b33917781 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:06.728997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96391122-b091-4c8c-8508-639b33917781 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:06.734891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:06.769858 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-96391122-b091-4c8c-8508-639b33917781 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056994 Jul 04 06:06:06.770626 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 716/1438] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:06:07.042894 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7a74cdf4-5e4b-405a-801b-f8de92ba619b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:07.043616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7a74cdf4-5e4b-405a-801b-f8de92ba619b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:07.051136 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a74cdf4-5e4b-405a-801b-f8de92ba619b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:07.051608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a74cdf4-5e4b-405a-801b-f8de92ba619b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:07.052400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a74cdf4-5e4b-405a-801b-f8de92ba619b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:07.052833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a74cdf4-5e4b-405a-801b-f8de92ba619b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:07.194021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7a74cdf4-5e4b-405a-801b-f8de92ba619b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:06:07.203203 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7a74cdf4-5e4b-405a-801b-f8de92ba619b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:06:07.205074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7a74cdf4-5e4b-405a-801b-f8de92ba619b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '982651a870c44a07bc4df322919e605e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3251b70a6c64287acc95cc99d4e3b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:06:07.206314 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7a74cdf4-5e4b-405a-801b-f8de92ba619b tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 200 len: 1654 microversion: 2.20 time: 0.168170 Jul 04 06:06:07.207719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 723/1439] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 06:06:07 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 1654 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 06:06:07.398686 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-098270f5-0e48-4b35-afda-6f9314e79b53 req-542163c6-7d67-45ee-81b7-e611319d3796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87fa4b2-597e-431a-bd5e-45f8c7395529", "name": "network-vif-deleted", "tag": "787e112a-b1bf-41ce-b99d-6c3254cfc3aa"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:06:07.408330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-098270f5-0e48-4b35-afda-6f9314e79b53 req-542163c6-7d67-45ee-81b7-e611319d3796 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:07.408828 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-098270f5-0e48-4b35-afda-6f9314e79b53 req-542163c6-7d67-45ee-81b7-e611319d3796 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:07.421459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-098270f5-0e48-4b35-afda-6f9314e79b53 req-542163c6-7d67-45ee-81b7-e611319d3796 service nova] Creating event network-vif-deleted:787e112a-b1bf-41ce-b99d-6c3254cfc3aa for instance a87fa4b2-597e-431a-bd5e-45f8c7395529 on hv-cinder-79733 Jul 04 06:06:07.426957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-098270f5-0e48-4b35-afda-6f9314e79b53 req-542163c6-7d67-45ee-81b7-e611319d3796 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031860 Jul 04 06:06:07.427692 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 717/1440] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:07.785747 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-009aeb99-50d0-4393-97fd-4f69421543ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:07.787154 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-009aeb99-50d0-4393-97fd-4f69421543ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:07.795441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-009aeb99-50d0-4393-97fd-4f69421543ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:07.796951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-009aeb99-50d0-4393-97fd-4f69421543ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:07.796951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-009aeb99-50d0-4393-97fd-4f69421543ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:07.797559 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-009aeb99-50d0-4393-97fd-4f69421543ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:07.831517 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-009aeb99-50d0-4393-97fd-4f69421543ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053398 Jul 04 06:06:07.832525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 724/1441] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:08.226339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6467c7bf-8aaf-4d44-97b7-b0ec54a43a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:08.227071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6467c7bf-8aaf-4d44-97b7-b0ec54a43a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:08.233980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6467c7bf-8aaf-4d44-97b7-b0ec54a43a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:08.234434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6467c7bf-8aaf-4d44-97b7-b0ec54a43a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:08.235210 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6467c7bf-8aaf-4d44-97b7-b0ec54a43a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:08.235700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6467c7bf-8aaf-4d44-97b7-b0ec54a43a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:08.257992 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-6467c7bf-8aaf-4d44-97b7-b0ec54a43a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] HTTP exception thrown: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6467c7bf-8aaf-4d44-97b7-b0ec54a43a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Request method failure captured: Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 HTTP/1.1 Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoB8bKsJbNvGOnJjkpXV9bswTHj3lvwmYf__bTpxb2VlLNE2omAzkDjdRLHE1uFhHtcDQ1zYoQVE7lUvW_r_RK0AyDeSWrYbMF_qOnsoDGhYORcDduFofYuPv_uj9uZoyMIkGuP-AxfvlL4ICDPHroDYuGc-vuMdyYkjQJ4MJ96ufkc Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:06:08.259709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 982651a870c44a07bc4df322919e605e Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:06:08.261463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': 'a87fa4b2-597e-431a-bd5e-45f8c7395529'} Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:06:08.262449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:06:08.263929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:06:08.266149 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6467c7bf-8aaf-4d44-97b7-b0ec54a43a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Returning 404 to user: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:06:08.266149 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6467c7bf-8aaf-4d44-97b7-b0ec54a43a06 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 404 len: 111 microversion: 2.20 time: 0.039571 Jul 04 06:06:08.266149 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 718/1442] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 06:06:08 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 06:06:08.271238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b8dc9bba-3252-4c78-8c55-40093670fb42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '.version_select at 0x7f2047774940>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:08.293317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b8dc9bba-3252-4c78-8c55-40093670fb42 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673075183" status: 204 len: 0 microversion: 2.20 time: 0.026451 Jul 04 06:06:08.293908 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 725/1443] 10.222.0.42 () {60 vars in 1258 bytes} [Mon Jul 4 06:06:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673075183 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 06:06:08.843777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e9bf3f35-7cf7-4f13-ad9f-2db4b1d67e8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:08.844729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e9bf3f35-7cf7-4f13-ad9f-2db4b1d67e8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:08.853264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9bf3f35-7cf7-4f13-ad9f-2db4b1d67e8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:08.853695 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9bf3f35-7cf7-4f13-ad9f-2db4b1d67e8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:08.854480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9bf3f35-7cf7-4f13-ad9f-2db4b1d67e8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:08.854914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9bf3f35-7cf7-4f13-ad9f-2db4b1d67e8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:08.893859 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e9bf3f35-7cf7-4f13-ad9f-2db4b1d67e8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053484 Jul 04 06:06:08.893859 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 719/1444] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:08 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:09.909342 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1d6ad007-5975-4ff5-a8a9-66d01dd87b32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:09.910251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1d6ad007-5975-4ff5-a8a9-66d01dd87b32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:09.917388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d6ad007-5975-4ff5-a8a9-66d01dd87b32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:09.917832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d6ad007-5975-4ff5-a8a9-66d01dd87b32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:09.918630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d6ad007-5975-4ff5-a8a9-66d01dd87b32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:09.919065 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1d6ad007-5975-4ff5-a8a9-66d01dd87b32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:09.948819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1d6ad007-5975-4ff5-a8a9-66d01dd87b32 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046332 Jul 04 06:06:09.949363 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 726/1445] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:10.962258 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bfb23381-3756-4e16-b599-f0a08195ba83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:10.963344 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bfb23381-3756-4e16-b599-f0a08195ba83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:10.971935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfb23381-3756-4e16-b599-f0a08195ba83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:10.972509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfb23381-3756-4e16-b599-f0a08195ba83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:10.973467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfb23381-3756-4e16-b599-f0a08195ba83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:10.974016 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfb23381-3756-4e16-b599-f0a08195ba83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:11.012349 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bfb23381-3756-4e16-b599-f0a08195ba83 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048587 Jul 04 06:06:11.012349 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 720/1446] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:10 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:12.022661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-95d5e8d2-044a-4b47-a03e-002625d32907 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:12.024294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-95d5e8d2-044a-4b47-a03e-002625d32907 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:12.034070 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95d5e8d2-044a-4b47-a03e-002625d32907 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:12.034558 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95d5e8d2-044a-4b47-a03e-002625d32907 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:12.035402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95d5e8d2-044a-4b47-a03e-002625d32907 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:12.035876 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95d5e8d2-044a-4b47-a03e-002625d32907 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:12.065404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-95d5e8d2-044a-4b47-a03e-002625d32907 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050357 Jul 04 06:06:12.066035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 727/1447] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:12 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:13.080202 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-608cf285-7655-4412-b87b-4e0c9ea5d83e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:13.081716 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-608cf285-7655-4412-b87b-4e0c9ea5d83e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:13.090344 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-608cf285-7655-4412-b87b-4e0c9ea5d83e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:13.090939 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-608cf285-7655-4412-b87b-4e0c9ea5d83e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:13.091998 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-608cf285-7655-4412-b87b-4e0c9ea5d83e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:13.092575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-608cf285-7655-4412-b87b-4e0c9ea5d83e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:13.124378 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-608cf285-7655-4412-b87b-4e0c9ea5d83e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050077 Jul 04 06:06:13.125211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 721/1448] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:13 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:14.140882 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6eda5412-2e36-4492-97ce-1914b9c20f1a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:14.141955 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6eda5412-2e36-4492-97ce-1914b9c20f1a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:14.153301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6eda5412-2e36-4492-97ce-1914b9c20f1a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:14.154315 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6eda5412-2e36-4492-97ce-1914b9c20f1a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:14.155755 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6eda5412-2e36-4492-97ce-1914b9c20f1a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:14.156521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6eda5412-2e36-4492-97ce-1914b9c20f1a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:14.187340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6eda5412-2e36-4492-97ce-1914b9c20f1a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053645 Jul 04 06:06:14.187913 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 728/1449] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:14 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:15.199552 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-17439582-c17a-4506-9bb7-d9ab9b3ab23d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:15.200480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-17439582-c17a-4506-9bb7-d9ab9b3ab23d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:15.207717 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17439582-c17a-4506-9bb7-d9ab9b3ab23d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:15.208220 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17439582-c17a-4506-9bb7-d9ab9b3ab23d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:15.209129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17439582-c17a-4506-9bb7-d9ab9b3ab23d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:15.209451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17439582-c17a-4506-9bb7-d9ab9b3ab23d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:15.239911 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-17439582-c17a-4506-9bb7-d9ab9b3ab23d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044370 Jul 04 06:06:15.240689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 722/1450] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:16.254991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-87ecf827-d99d-4118-b8c2-b5ad8c4461a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:16.256179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-87ecf827-d99d-4118-b8c2-b5ad8c4461a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:16.264621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87ecf827-d99d-4118-b8c2-b5ad8c4461a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:16.265179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87ecf827-d99d-4118-b8c2-b5ad8c4461a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:16.266124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87ecf827-d99d-4118-b8c2-b5ad8c4461a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:16.266704 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87ecf827-d99d-4118-b8c2-b5ad8c4461a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:16.299619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-87ecf827-d99d-4118-b8c2-b5ad8c4461a5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050338 Jul 04 06:06:16.300160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 729/1451] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:17.311705 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b36fa854-3a67-417d-9f2b-c9df858da0b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:17.312703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b36fa854-3a67-417d-9f2b-c9df858da0b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:17.319629 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b36fa854-3a67-417d-9f2b-c9df858da0b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:17.320057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b36fa854-3a67-417d-9f2b-c9df858da0b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:17.320792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b36fa854-3a67-417d-9f2b-c9df858da0b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:17.321229 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b36fa854-3a67-417d-9f2b-c9df858da0b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:17.351328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b36fa854-3a67-417d-9f2b-c9df858da0b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Jul 04 06:06:17.351905 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 723/1452] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:18.367173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eadf0a82-f828-4426-9820-dbdac32a4da6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:18.368570 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eadf0a82-f828-4426-9820-dbdac32a4da6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:18.380370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eadf0a82-f828-4426-9820-dbdac32a4da6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:18.380775 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eadf0a82-f828-4426-9820-dbdac32a4da6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:18.381531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eadf0a82-f828-4426-9820-dbdac32a4da6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:18.381957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eadf0a82-f828-4426-9820-dbdac32a4da6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:18.411846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eadf0a82-f828-4426-9820-dbdac32a4da6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051249 Jul 04 06:06:18.412405 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 730/1453] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:19.427777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-33846d6f-bbed-4885-964c-743b60a2dd42 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:19.428936 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-33846d6f-bbed-4885-964c-743b60a2dd42 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:19.437371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33846d6f-bbed-4885-964c-743b60a2dd42 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:19.437928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33846d6f-bbed-4885-964c-743b60a2dd42 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:19.438869 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33846d6f-bbed-4885-964c-743b60a2dd42 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:19.439437 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33846d6f-bbed-4885-964c-743b60a2dd42 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:19.473124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-33846d6f-bbed-4885-964c-743b60a2dd42 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051932 Jul 04 06:06:19.473905 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 724/1454] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:06:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:06:20.489307 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d2e25cf1-9266-4549-83f7-794cf8d7fee2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:06:20.490795 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d2e25cf1-9266-4549-83f7-794cf8d7fee2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:20.501560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2e25cf1-9266-4549-83f7-794cf8d7fee2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:20.502308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2e25cf1-9266-4549-83f7-794cf8d7fee2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:20.503609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2e25cf1-9266-4549-83f7-794cf8d7fee2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:20.504401 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2e25cf1-9266-4549-83f7-794cf8d7fee2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:20.584624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d2e25cf1-9266-4549-83f7-794cf8d7fee2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "POST /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/action" status: 200 len: 76038 microversion: 2.1 time: 0.101808 Jul 04 06:06:20.585224 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 731/1455] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 06:06:20 2022] POST /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620/action => generated 76038 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 06:06:58.037979 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5b4a6700-eda4-4fc1-b282-decd86f4c2df tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:58.038560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5b4a6700-eda4-4fc1-b282-decd86f4c2df tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:58.040875 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:58.041523 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=44 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:58.047735 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b4a6700-eda4-4fc1-b282-decd86f4c2df tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:58.048175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b4a6700-eda4-4fc1-b282-decd86f4c2df tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:58.048944 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b4a6700-eda4-4fc1-b282-decd86f4c2df tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:58.049372 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b4a6700-eda4-4fc1-b282-decd86f4c2df tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:58.077441 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5b4a6700-eda4-4fc1-b282-decd86f4c2df tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:06:58.163665 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5b4a6700-eda4-4fc1-b282-decd86f4c2df tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 204 len: 0 microversion: 2.1 time: 0.129200 Jul 04 06:06:58.164511 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 725/1456] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:06:58 2022] DELETE /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 06:06:58.173476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-af0a38aa-eaf6-43f7-a91f-59748ad617b7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:58.174181 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-af0a38aa-eaf6-43f7-a91f-59748ad617b7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:58.176808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:58.177491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=75 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:58.183755 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af0a38aa-eaf6-43f7-a91f-59748ad617b7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:58.184204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af0a38aa-eaf6-43f7-a91f-59748ad617b7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:58.184969 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af0a38aa-eaf6-43f7-a91f-59748ad617b7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:58.185406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af0a38aa-eaf6-43f7-a91f-59748ad617b7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:58.331224 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-af0a38aa-eaf6-43f7-a91f-59748ad617b7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:06:58.339220 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-af0a38aa-eaf6-43f7-a91f-59748ad617b7 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1673 microversion: 2.1 time: 0.170102 Jul 04 06:06:58.339817 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 732/1457] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:06:58 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:06:59.358795 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bc312976-8425-4d39-9a24-a3910fc33119 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:06:59.359517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bc312976-8425-4d39-9a24-a3910fc33119 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:06:59.366049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc312976-8425-4d39-9a24-a3910fc33119 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:59.367509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc312976-8425-4d39-9a24-a3910fc33119 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:59.368591 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc312976-8425-4d39-9a24-a3910fc33119 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:59.369451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc312976-8425-4d39-9a24-a3910fc33119 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:59.416763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-73e3e1c8-b288-433d-8a95-512cc71e88f4 req-1c8ccef3-49af-41ba-ace5-6408e96b7aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c1202bc-e2f9-4a89-b2da-819b3132f5bd", "name": "network-vif-deleted", "tag": "e17f2251-ccbb-45d3-ba0a-ca2b1e84120b"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:06:59.432285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-73e3e1c8-b288-433d-8a95-512cc71e88f4 req-1c8ccef3-49af-41ba-ace5-6408e96b7aad service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:06:59.432756 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-73e3e1c8-b288-433d-8a95-512cc71e88f4 req-1c8ccef3-49af-41ba-ace5-6408e96b7aad service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:06:59.444291 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bc312976-8425-4d39-9a24-a3910fc33119 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32703b5451cf48b09966a7412b747099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd96113d4ef451d9ffc81c03c6ea70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:06:59.448287 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-73e3e1c8-b288-433d-8a95-512cc71e88f4 req-1c8ccef3-49af-41ba-ace5-6408e96b7aad service nova] Creating event network-vif-deleted:e17f2251-ccbb-45d3-ba0a-ca2b1e84120b for instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd on hv-cinder-79733 Jul 04 06:06:59.455395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-73e3e1c8-b288-433d-8a95-512cc71e88f4 req-1c8ccef3-49af-41ba-ace5-6408e96b7aad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042157 Jul 04 06:06:59.457961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bc312976-8425-4d39-9a24-a3910fc33119 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 200 len: 1606 microversion: 2.1 time: 0.104369 Jul 04 06:06:59.459341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 726/1458] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:06:59 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 1606 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:06:59.461422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 733/1459] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:07:00.476041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ed3d327d-6dea-4427-be5d-0cea69481265 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:07:00.476693 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ed3d327d-6dea-4427-be5d-0cea69481265 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:07:00.483540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed3d327d-6dea-4427-be5d-0cea69481265 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:07:00.483989 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed3d327d-6dea-4427-be5d-0cea69481265 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:07:00.484741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed3d327d-6dea-4427-be5d-0cea69481265 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:07:00.485170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed3d327d-6dea-4427-be5d-0cea69481265 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:07:00.499970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-ed3d327d-6dea-4427-be5d-0cea69481265 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] HTTP exception thrown: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ed3d327d-6dea-4427-be5d-0cea69481265 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Request method failure captured: Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd HTTP/1.1 Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoCEUy_tkDjUbVKcexapYDAsm40eALAF_dR72XCRiPOAjjY_kvltuR8PCLFjH0f4aNu7xrSw_7JDtTHQcBWxoA1U4NVcaSanOU_o948upgIv2ysLLAABEBrFpimbso2wYYcX-Syirc3zdf6h3irlfBmfus4yp-93Cx-MzRohzZ4xanY Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:07:00.501906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 32703b5451cf48b09966a7412b747099 Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:07:00.503440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '6c1202bc-e2f9-4a89-b2da-819b3132f5bd'} Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:07:00.504269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:07:00.505608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:07:00.506880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ed3d327d-6dea-4427-be5d-0cea69481265 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Returning 404 to user: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:07:00.506880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ed3d327d-6dea-4427-be5d-0cea69481265 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 404 len: 111 microversion: 2.1 time: 0.031241 Jul 04 06:07:00.507515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 727/1460] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:07:00 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:07:00.514638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-453f2c3f-9dc5-4620-ab9f-be4362c37685 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '.version_select at 0x7f2047774a60>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:07:00.535547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-453f2c3f-9dc5-4620-ab9f-be4362c37685 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-363545843" status: 202 len: 0 microversion: 2.1 time: 0.026517 Jul 04 06:07:00.536210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 734/1461] 10.222.0.42 () {58 vars in 1217 bytes} [Mon Jul 4 06:07:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-363545843 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:07:25.730909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:07:25.730909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:07:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:07:36.971514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:07:36.972558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:07:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:09:11.820310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:09:11.821146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:09:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:09:29.578557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:09:29.579235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:09:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:10:26.749214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9532a89-354a-4905-bb83-9d0bf8d62961] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 04 06:10:26.752128 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c58372f0-2acd-4201-a0cf-1e61633d26b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] Calling method '.version_select at 0x7f204776d790>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:26.756176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c58372f0-2acd-4201-a0cf-1e61633d26b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [a6522c6f-107f-4cf8-a340-b761d2ae0e6e] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 04 06:10:26.756731 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:10:26.757820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:10:27.758906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9532a89-354a-4905-bb83-9d0bf8d62961] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 57854. Jul 04 06:10:27.763862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [None req-c58372f0-2acd-4201-a0cf-1e61633d26b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] [a6522c6f-107f-4cf8-a340-b761d2ae0e6e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 57858. Jul 04 06:10:27.790894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c58372f0-2acd-4201-a0cf-1e61633d26b0 tempest-TestVolumeBootPattern-603168068 tempest-TestVolumeBootPattern-603168068-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-426821201" status: 202 len: 0 microversion: 2.1 time: 1.044537 Jul 04 06:10:27.791503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 728/1462] 10.222.0.42 () {58 vars in 1259 bytes} [Mon Jul 4 06:10:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-426821201 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:10:31.936782 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c275389b-a71d-4d09-9367-a2e4fce5ff41] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 04 06:10:31.937920 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=8 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:10:31.938630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:10:31.944160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cf5fce94-b869-47f7-9506-912b21ff12d3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:31.945034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cf5fce94-b869-47f7-9506-912b21ff12d3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:31.953079 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf5fce94-b869-47f7-9506-912b21ff12d3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:31.953512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf5fce94-b869-47f7-9506-912b21ff12d3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:31.954491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf5fce94-b869-47f7-9506-912b21ff12d3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:31.954918 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf5fce94-b869-47f7-9506-912b21ff12d3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:31.997483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cf5fce94-b869-47f7-9506-912b21ff12d3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:10:32.103426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cf5fce94-b869-47f7-9506-912b21ff12d3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 204 len: 0 microversion: 2.1 time: 0.168304 Jul 04 06:10:32.104934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 735/1463] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:10:31 2022] DELETE /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 06:10:32.119480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef600774-7d57-4b8e-8eff-bae91434cbde tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:32.119480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef600774-7d57-4b8e-8eff-bae91434cbde tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:32.126959 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef600774-7d57-4b8e-8eff-bae91434cbde tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:32.127459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef600774-7d57-4b8e-8eff-bae91434cbde tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:32.128246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef600774-7d57-4b8e-8eff-bae91434cbde tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:32.128685 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef600774-7d57-4b8e-8eff-bae91434cbde tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:32.726302 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef600774-7d57-4b8e-8eff-bae91434cbde tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:32.734346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef600774-7d57-4b8e-8eff-bae91434cbde tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.624783 Jul 04 06:10:32.734881 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 729/1464] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:32 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:10:33.757180 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ff67a7b3-843d-4382-a7b7-97bd2692e5d0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:33.758755 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ff67a7b3-843d-4382-a7b7-97bd2692e5d0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:33.771403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff67a7b3-843d-4382-a7b7-97bd2692e5d0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:33.771935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff67a7b3-843d-4382-a7b7-97bd2692e5d0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:33.772781 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff67a7b3-843d-4382-a7b7-97bd2692e5d0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:33.773284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff67a7b3-843d-4382-a7b7-97bd2692e5d0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:33.777287 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] [c275389b-a71d-4d09-9367-a2e4fce5ff41] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 57950. Jul 04 06:10:34.043539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ff67a7b3-843d-4382-a7b7-97bd2692e5d0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:34.052926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ff67a7b3-843d-4382-a7b7-97bd2692e5d0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.300522 Jul 04 06:10:34.053537 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 736/1465] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:33 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:35.070171 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba4fce27-c405-40bd-bc93-0320723af854 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:35.070821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba4fce27-c405-40bd-bc93-0320723af854 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:35.078212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4fce27-c405-40bd-bc93-0320723af854 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:35.078664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4fce27-c405-40bd-bc93-0320723af854 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:35.079481 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4fce27-c405-40bd-bc93-0320723af854 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:35.079920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4fce27-c405-40bd-bc93-0320723af854 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:35.221764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ba4fce27-c405-40bd-bc93-0320723af854 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:35.233580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba4fce27-c405-40bd-bc93-0320723af854 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167268 Jul 04 06:10:35.244033 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 730/1466] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:35 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:36.255227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3f97b65-ff52-4e17-b3a3-683c9b063e92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:36.256197 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e3f97b65-ff52-4e17-b3a3-683c9b063e92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:36.267354 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3f97b65-ff52-4e17-b3a3-683c9b063e92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:36.268129 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3f97b65-ff52-4e17-b3a3-683c9b063e92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:36.269492 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3f97b65-ff52-4e17-b3a3-683c9b063e92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:36.270241 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3f97b65-ff52-4e17-b3a3-683c9b063e92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:36.412656 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e3f97b65-ff52-4e17-b3a3-683c9b063e92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:36.422185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e3f97b65-ff52-4e17-b3a3-683c9b063e92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.173363 Jul 04 06:10:36.423005 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 737/1467] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:36 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:37.444405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7354f021-c6d9-4bc4-8f2d-41b535dfaa68 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:37.445019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7354f021-c6d9-4bc4-8f2d-41b535dfaa68 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:37.451740 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7354f021-c6d9-4bc4-8f2d-41b535dfaa68 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:37.452192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7354f021-c6d9-4bc4-8f2d-41b535dfaa68 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:37.452956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7354f021-c6d9-4bc4-8f2d-41b535dfaa68 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:37.453402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7354f021-c6d9-4bc4-8f2d-41b535dfaa68 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:37.597846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7354f021-c6d9-4bc4-8f2d-41b535dfaa68 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:37.606079 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7354f021-c6d9-4bc4-8f2d-41b535dfaa68 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168584 Jul 04 06:10:37.606632 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 731/1468] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:37 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:38.623140 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3e6dd677-b030-4587-b24b-4c89d67844ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:38.623835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3e6dd677-b030-4587-b24b-4c89d67844ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:38.630908 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e6dd677-b030-4587-b24b-4c89d67844ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:38.631383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e6dd677-b030-4587-b24b-4c89d67844ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:38.632157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e6dd677-b030-4587-b24b-4c89d67844ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:38.632569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e6dd677-b030-4587-b24b-4c89d67844ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:38.770287 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3e6dd677-b030-4587-b24b-4c89d67844ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:38.783308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3e6dd677-b030-4587-b24b-4c89d67844ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163599 Jul 04 06:10:38.784105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 738/1469] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:38 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:39.804110 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4301f1a1-d6d7-432c-9141-d2a9681acb4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:39.804631 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4301f1a1-d6d7-432c-9141-d2a9681acb4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:39.811707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4301f1a1-d6d7-432c-9141-d2a9681acb4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:39.812159 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4301f1a1-d6d7-432c-9141-d2a9681acb4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:39.812921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4301f1a1-d6d7-432c-9141-d2a9681acb4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:39.813352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4301f1a1-d6d7-432c-9141-d2a9681acb4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:39.947584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4301f1a1-d6d7-432c-9141-d2a9681acb4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:39.955941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4301f1a1-d6d7-432c-9141-d2a9681acb4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.157199 Jul 04 06:10:39.956493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 732/1470] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:39 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:40.976756 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-64127f01-86d8-4ba1-8c7f-6a99b324e860 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:40.977573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-64127f01-86d8-4ba1-8c7f-6a99b324e860 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:40.987433 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64127f01-86d8-4ba1-8c7f-6a99b324e860 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:40.988158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64127f01-86d8-4ba1-8c7f-6a99b324e860 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:40.989347 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64127f01-86d8-4ba1-8c7f-6a99b324e860 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:40.989925 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64127f01-86d8-4ba1-8c7f-6a99b324e860 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:41.137252 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-64127f01-86d8-4ba1-8c7f-6a99b324e860 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:41.145843 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-64127f01-86d8-4ba1-8c7f-6a99b324e860 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.174899 Jul 04 06:10:41.146417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 739/1471] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:40 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:42.167431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e331f5d2-256b-4a34-b3c5-2c5cb9d8b712 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:42.168307 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e331f5d2-256b-4a34-b3c5-2c5cb9d8b712 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:42.178736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e331f5d2-256b-4a34-b3c5-2c5cb9d8b712 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:42.179185 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e331f5d2-256b-4a34-b3c5-2c5cb9d8b712 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:42.179991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e331f5d2-256b-4a34-b3c5-2c5cb9d8b712 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:42.180425 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e331f5d2-256b-4a34-b3c5-2c5cb9d8b712 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:42.328946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e331f5d2-256b-4a34-b3c5-2c5cb9d8b712 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:42.337538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e331f5d2-256b-4a34-b3c5-2c5cb9d8b712 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.176712 Jul 04 06:10:42.338103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 733/1472] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:42 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:43.358810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fa2c39a7-1296-4202-baf0-9f20a2c9eac7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:43.359763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fa2c39a7-1296-4202-baf0-9f20a2c9eac7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:43.370965 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa2c39a7-1296-4202-baf0-9f20a2c9eac7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:43.371762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa2c39a7-1296-4202-baf0-9f20a2c9eac7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:43.373025 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa2c39a7-1296-4202-baf0-9f20a2c9eac7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:43.373756 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa2c39a7-1296-4202-baf0-9f20a2c9eac7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:43.514454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fa2c39a7-1296-4202-baf0-9f20a2c9eac7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:43.524433 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fa2c39a7-1296-4202-baf0-9f20a2c9eac7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.172135 Jul 04 06:10:43.525002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 740/1473] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:43 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:44.542727 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2dc14875-788a-492f-97a7-e1ad9dc03530 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:44.543374 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2dc14875-788a-492f-97a7-e1ad9dc03530 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:44.550321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dc14875-788a-492f-97a7-e1ad9dc03530 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:44.550764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dc14875-788a-492f-97a7-e1ad9dc03530 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:44.551569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dc14875-788a-492f-97a7-e1ad9dc03530 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:44.552005 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dc14875-788a-492f-97a7-e1ad9dc03530 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:44.681955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2dc14875-788a-492f-97a7-e1ad9dc03530 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:44.690170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2dc14875-788a-492f-97a7-e1ad9dc03530 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.151778 Jul 04 06:10:44.690737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 734/1474] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:44 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:45.711928 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cb9a5c1b-204b-4e20-8768-49805eaa311d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:45.712856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cb9a5c1b-204b-4e20-8768-49805eaa311d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:45.723952 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb9a5c1b-204b-4e20-8768-49805eaa311d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:45.724649 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb9a5c1b-204b-4e20-8768-49805eaa311d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:45.725420 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb9a5c1b-204b-4e20-8768-49805eaa311d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:45.725848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb9a5c1b-204b-4e20-8768-49805eaa311d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:45.866871 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cb9a5c1b-204b-4e20-8768-49805eaa311d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:45.875504 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cb9a5c1b-204b-4e20-8768-49805eaa311d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169960 Jul 04 06:10:45.876083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 741/1475] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:45 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:46.896743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e74459c7-240b-4faf-b635-dc9520bf68ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:46.897749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e74459c7-240b-4faf-b635-dc9520bf68ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:46.909217 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e74459c7-240b-4faf-b635-dc9520bf68ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:46.909956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e74459c7-240b-4faf-b635-dc9520bf68ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:46.911216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e74459c7-240b-4faf-b635-dc9520bf68ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:46.912261 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e74459c7-240b-4faf-b635-dc9520bf68ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:47.048775 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e74459c7-240b-4faf-b635-dc9520bf68ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:47.057782 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e74459c7-240b-4faf-b635-dc9520bf68ce tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167714 Jul 04 06:10:47.058548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 735/1476] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:46 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:48.075917 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa57f155-31f7-4628-acc4-c46d546a03c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:48.076665 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aa57f155-31f7-4628-acc4-c46d546a03c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:48.083491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa57f155-31f7-4628-acc4-c46d546a03c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:48.084012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa57f155-31f7-4628-acc4-c46d546a03c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:48.085032 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa57f155-31f7-4628-acc4-c46d546a03c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:48.085447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa57f155-31f7-4628-acc4-c46d546a03c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:48.217557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aa57f155-31f7-4628-acc4-c46d546a03c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:48.225678 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aa57f155-31f7-4628-acc4-c46d546a03c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.154157 Jul 04 06:10:48.226246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 742/1477] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:48 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:49.241952 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e25214d5-4e2e-487f-8d2b-35d36955e297 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:49.242560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e25214d5-4e2e-487f-8d2b-35d36955e297 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:49.249328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e25214d5-4e2e-487f-8d2b-35d36955e297 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:49.249786 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e25214d5-4e2e-487f-8d2b-35d36955e297 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:49.250555 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e25214d5-4e2e-487f-8d2b-35d36955e297 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:49.251016 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e25214d5-4e2e-487f-8d2b-35d36955e297 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:49.386060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e25214d5-4e2e-487f-8d2b-35d36955e297 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:49.399013 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e25214d5-4e2e-487f-8d2b-35d36955e297 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.160605 Jul 04 06:10:49.399844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 736/1478] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:49 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:50.425843 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7558041b-a5e6-4e23-9e4d-97da237e3134 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:50.426729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7558041b-a5e6-4e23-9e4d-97da237e3134 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:50.433968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7558041b-a5e6-4e23-9e4d-97da237e3134 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:50.434414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7558041b-a5e6-4e23-9e4d-97da237e3134 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:50.435161 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7558041b-a5e6-4e23-9e4d-97da237e3134 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:50.435619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7558041b-a5e6-4e23-9e4d-97da237e3134 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:50.564870 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7558041b-a5e6-4e23-9e4d-97da237e3134 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:50.575140 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7558041b-a5e6-4e23-9e4d-97da237e3134 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156446 Jul 04 06:10:50.575740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 743/1479] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:50 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:51.597176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3749ce97-409e-4844-9157-88f4fe519ace tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:51.598162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3749ce97-409e-4844-9157-88f4fe519ace tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:51.606191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3749ce97-409e-4844-9157-88f4fe519ace tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:51.606892 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3749ce97-409e-4844-9157-88f4fe519ace tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:51.607988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3749ce97-409e-4844-9157-88f4fe519ace tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:51.607988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3749ce97-409e-4844-9157-88f4fe519ace tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:51.753163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3749ce97-409e-4844-9157-88f4fe519ace tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:51.762876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3749ce97-409e-4844-9157-88f4fe519ace tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.172412 Jul 04 06:10:51.763509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 737/1480] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:51 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:52.788328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5acacff-7753-4034-8f47-4e10fff333d8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:52.789257 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5acacff-7753-4034-8f47-4e10fff333d8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:52.800575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5acacff-7753-4034-8f47-4e10fff333d8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:52.801318 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5acacff-7753-4034-8f47-4e10fff333d8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:52.802560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5acacff-7753-4034-8f47-4e10fff333d8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:52.803317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5acacff-7753-4034-8f47-4e10fff333d8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:52.946485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d5acacff-7753-4034-8f47-4e10fff333d8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:52.955437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5acacff-7753-4034-8f47-4e10fff333d8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.173556 Jul 04 06:10:52.956009 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 744/1481] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:52 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:53.977948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0f6fd035-83b1-4cec-9769-ab36afea25a6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:53.978904 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0f6fd035-83b1-4cec-9769-ab36afea25a6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:53.989826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f6fd035-83b1-4cec-9769-ab36afea25a6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:53.990572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f6fd035-83b1-4cec-9769-ab36afea25a6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:53.991691 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f6fd035-83b1-4cec-9769-ab36afea25a6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:53.992124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f6fd035-83b1-4cec-9769-ab36afea25a6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:54.137659 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0f6fd035-83b1-4cec-9769-ab36afea25a6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:54.145777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0f6fd035-83b1-4cec-9769-ab36afea25a6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.174455 Jul 04 06:10:54.146336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 738/1482] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:53 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:55.166454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-30a206ec-502b-4723-ab68-f92eb1b2b88a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:55.167168 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-30a206ec-502b-4723-ab68-f92eb1b2b88a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:55.175747 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30a206ec-502b-4723-ab68-f92eb1b2b88a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:55.176296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30a206ec-502b-4723-ab68-f92eb1b2b88a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:55.177234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30a206ec-502b-4723-ab68-f92eb1b2b88a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:55.177777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30a206ec-502b-4723-ab68-f92eb1b2b88a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:55.318750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-30a206ec-502b-4723-ab68-f92eb1b2b88a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:55.326948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-30a206ec-502b-4723-ab68-f92eb1b2b88a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165958 Jul 04 06:10:55.327542 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 745/1483] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:55 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:56.346327 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-71ad2b4a-ff74-4c7e-874c-ae0c9217b966 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:56.347046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-71ad2b4a-ff74-4c7e-874c-ae0c9217b966 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:56.355300 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71ad2b4a-ff74-4c7e-874c-ae0c9217b966 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:56.355866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71ad2b4a-ff74-4c7e-874c-ae0c9217b966 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:56.356764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71ad2b4a-ff74-4c7e-874c-ae0c9217b966 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:56.357273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71ad2b4a-ff74-4c7e-874c-ae0c9217b966 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:56.498571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-71ad2b4a-ff74-4c7e-874c-ae0c9217b966 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:56.506846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-71ad2b4a-ff74-4c7e-874c-ae0c9217b966 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165777 Jul 04 06:10:56.507632 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 739/1484] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:56 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:56.984229 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:10:56.984515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:10:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:10:57.524956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-60ebdfae-7a88-4877-922f-650a611b6827 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:57.525607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-60ebdfae-7a88-4877-922f-650a611b6827 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:57.532975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60ebdfae-7a88-4877-922f-650a611b6827 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:57.533463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60ebdfae-7a88-4877-922f-650a611b6827 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:57.534233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60ebdfae-7a88-4877-922f-650a611b6827 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:57.534667 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60ebdfae-7a88-4877-922f-650a611b6827 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:57.690800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-60ebdfae-7a88-4877-922f-650a611b6827 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:57.707728 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-60ebdfae-7a88-4877-922f-650a611b6827 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.186979 Jul 04 06:10:57.708303 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 746/1485] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:57 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:58.724088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-34fae1d3-b45f-41b5-bd8d-afe38df48e69 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:58.724695 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-34fae1d3-b45f-41b5-bd8d-afe38df48e69 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:58.726581 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:10:58.732209 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34fae1d3-b45f-41b5-bd8d-afe38df48e69 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:58.732664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34fae1d3-b45f-41b5-bd8d-afe38df48e69 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:58.733468 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34fae1d3-b45f-41b5-bd8d-afe38df48e69 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:58.733899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34fae1d3-b45f-41b5-bd8d-afe38df48e69 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:58.737269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=67 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:10:58.879019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-34fae1d3-b45f-41b5-bd8d-afe38df48e69 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:10:58.887670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-34fae1d3-b45f-41b5-bd8d-afe38df48e69 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167497 Jul 04 06:10:58.888228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 740/1486] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:58 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:10:59.904738 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5307862a-3cfb-4705-9007-880a547df06d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:10:59.905834 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5307862a-3cfb-4705-9007-880a547df06d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:10:59.912429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5307862a-3cfb-4705-9007-880a547df06d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:59.912863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5307862a-3cfb-4705-9007-880a547df06d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:10:59.913610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5307862a-3cfb-4705-9007-880a547df06d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:10:59.914102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5307862a-3cfb-4705-9007-880a547df06d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:00.051098 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5307862a-3cfb-4705-9007-880a547df06d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:00.060513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5307862a-3cfb-4705-9007-880a547df06d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159590 Jul 04 06:11:00.061375 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 747/1487] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:10:59 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:01.081621 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-91dc36e4-a797-45e4-b785-dc7160cb8bbb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:01.082510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-91dc36e4-a797-45e4-b785-dc7160cb8bbb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:01.093538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91dc36e4-a797-45e4-b785-dc7160cb8bbb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:01.094292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91dc36e4-a797-45e4-b785-dc7160cb8bbb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:01.095702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91dc36e4-a797-45e4-b785-dc7160cb8bbb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:01.096451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91dc36e4-a797-45e4-b785-dc7160cb8bbb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:01.237281 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-91dc36e4-a797-45e4-b785-dc7160cb8bbb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:01.250406 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-91dc36e4-a797-45e4-b785-dc7160cb8bbb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.175169 Jul 04 06:11:01.251074 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 741/1488] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:01 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:02.274042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-84e698e3-7556-4db3-871b-57e4e297a028 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:02.274658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-84e698e3-7556-4db3-871b-57e4e297a028 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:02.276975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:11:02.282789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84e698e3-7556-4db3-871b-57e4e297a028 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:02.283214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84e698e3-7556-4db3-871b-57e4e297a028 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:02.284018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84e698e3-7556-4db3-871b-57e4e297a028 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:02.284452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84e698e3-7556-4db3-871b-57e4e297a028 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:02.289037 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:11:02.424321 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-84e698e3-7556-4db3-871b-57e4e297a028 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:02.434708 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-84e698e3-7556-4db3-871b-57e4e297a028 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167120 Jul 04 06:11:02.435299 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 748/1489] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:02 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:03.453475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b1c6235-4a31-4505-952f-293ab46b3f1c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:03.454206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2b1c6235-4a31-4505-952f-293ab46b3f1c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:03.462335 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b1c6235-4a31-4505-952f-293ab46b3f1c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:03.462865 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b1c6235-4a31-4505-952f-293ab46b3f1c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:03.463820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b1c6235-4a31-4505-952f-293ab46b3f1c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:03.464356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b1c6235-4a31-4505-952f-293ab46b3f1c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:03.600244 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2b1c6235-4a31-4505-952f-293ab46b3f1c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:03.608862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2b1c6235-4a31-4505-952f-293ab46b3f1c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159973 Jul 04 06:11:03.609440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 742/1490] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:03 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:04.630227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a72e7a91-3231-479e-bd16-d52446d6e837 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:04.631300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a72e7a91-3231-479e-bd16-d52446d6e837 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:04.641655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72e7a91-3231-479e-bd16-d52446d6e837 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:04.642388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72e7a91-3231-479e-bd16-d52446d6e837 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:04.643692 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72e7a91-3231-479e-bd16-d52446d6e837 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:04.644397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72e7a91-3231-479e-bd16-d52446d6e837 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:04.779014 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a72e7a91-3231-479e-bd16-d52446d6e837 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:04.788154 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a72e7a91-3231-479e-bd16-d52446d6e837 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164583 Jul 04 06:11:04.788729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 749/1491] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:04 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:05.805716 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2d73434f-c39d-4925-80a1-b7e15bdf7f3b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:05.806312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2d73434f-c39d-4925-80a1-b7e15bdf7f3b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:05.813213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d73434f-c39d-4925-80a1-b7e15bdf7f3b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:05.813666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d73434f-c39d-4925-80a1-b7e15bdf7f3b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:05.814437 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d73434f-c39d-4925-80a1-b7e15bdf7f3b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:05.814874 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d73434f-c39d-4925-80a1-b7e15bdf7f3b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:05.946424 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2d73434f-c39d-4925-80a1-b7e15bdf7f3b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:05.958822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2d73434f-c39d-4925-80a1-b7e15bdf7f3b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156923 Jul 04 06:11:05.959627 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 743/1492] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:05 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:06.980547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1eaa4341-2ae6-4c12-88f4-48ab0176118b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:06.981527 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1eaa4341-2ae6-4c12-88f4-48ab0176118b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:06.992941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1eaa4341-2ae6-4c12-88f4-48ab0176118b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:06.993807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1eaa4341-2ae6-4c12-88f4-48ab0176118b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:06.994568 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1eaa4341-2ae6-4c12-88f4-48ab0176118b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:06.994997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1eaa4341-2ae6-4c12-88f4-48ab0176118b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:07.132631 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1eaa4341-2ae6-4c12-88f4-48ab0176118b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:07.141867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1eaa4341-2ae6-4c12-88f4-48ab0176118b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167872 Jul 04 06:11:07.142441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 750/1493] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:06 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:08.167908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8dc52ef1-11f1-4878-a049-842f30e5acee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:08.168853 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8dc52ef1-11f1-4878-a049-842f30e5acee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:08.180061 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8dc52ef1-11f1-4878-a049-842f30e5acee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:08.180819 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8dc52ef1-11f1-4878-a049-842f30e5acee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:08.182091 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8dc52ef1-11f1-4878-a049-842f30e5acee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:08.182821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8dc52ef1-11f1-4878-a049-842f30e5acee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:08.329092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8dc52ef1-11f1-4878-a049-842f30e5acee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:08.336934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8dc52ef1-11f1-4878-a049-842f30e5acee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.175612 Jul 04 06:11:08.337500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 744/1494] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:08 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:09.353304 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0071a244-0547-4c3a-926c-2b4d88b07ec2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:09.353901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0071a244-0547-4c3a-926c-2b4d88b07ec2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:09.361118 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0071a244-0547-4c3a-926c-2b4d88b07ec2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:09.361569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0071a244-0547-4c3a-926c-2b4d88b07ec2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:09.362363 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0071a244-0547-4c3a-926c-2b4d88b07ec2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:09.362799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0071a244-0547-4c3a-926c-2b4d88b07ec2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:09.497878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0071a244-0547-4c3a-926c-2b4d88b07ec2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:09.506354 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0071a244-0547-4c3a-926c-2b4d88b07ec2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156934 Jul 04 06:11:09.506938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 751/1495] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:09 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:10.523621 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-38a47eb5-e929-4282-bc8c-ff3987e31968 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:10.524268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-38a47eb5-e929-4282-bc8c-ff3987e31968 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:10.531662 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38a47eb5-e929-4282-bc8c-ff3987e31968 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:10.532094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38a47eb5-e929-4282-bc8c-ff3987e31968 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:10.532869 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38a47eb5-e929-4282-bc8c-ff3987e31968 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:10.533305 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38a47eb5-e929-4282-bc8c-ff3987e31968 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:10.672369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-38a47eb5-e929-4282-bc8c-ff3987e31968 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:10.684135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-38a47eb5-e929-4282-bc8c-ff3987e31968 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163861 Jul 04 06:11:10.684921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 745/1496] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:10 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:11.706095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0635e8e3-0e4e-426b-b9f3-415c3c26117c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:11.706974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0635e8e3-0e4e-426b-b9f3-415c3c26117c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:11.717975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0635e8e3-0e4e-426b-b9f3-415c3c26117c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:11.718723 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0635e8e3-0e4e-426b-b9f3-415c3c26117c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:11.720083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0635e8e3-0e4e-426b-b9f3-415c3c26117c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:11.720807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0635e8e3-0e4e-426b-b9f3-415c3c26117c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:11.868063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0635e8e3-0e4e-426b-b9f3-415c3c26117c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:11.877657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0635e8e3-0e4e-426b-b9f3-415c3c26117c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.178475 Jul 04 06:11:11.878449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 752/1497] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:11 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:12.905554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2524c21-0fbf-4683-811a-aaf3950e44f5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:12.906486 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c2524c21-0fbf-4683-811a-aaf3950e44f5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:12.917782 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2524c21-0fbf-4683-811a-aaf3950e44f5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:12.918573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2524c21-0fbf-4683-811a-aaf3950e44f5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:12.919893 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2524c21-0fbf-4683-811a-aaf3950e44f5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:12.920606 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2524c21-0fbf-4683-811a-aaf3950e44f5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:13.073538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c2524c21-0fbf-4683-811a-aaf3950e44f5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:13.081997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2524c21-0fbf-4683-811a-aaf3950e44f5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.183390 Jul 04 06:11:13.082572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 746/1498] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:12 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:14.103307 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea518d0c-4d3a-49d8-a913-83693409ee56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:14.104329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea518d0c-4d3a-49d8-a913-83693409ee56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:14.115283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea518d0c-4d3a-49d8-a913-83693409ee56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:14.116058 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea518d0c-4d3a-49d8-a913-83693409ee56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:14.117318 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea518d0c-4d3a-49d8-a913-83693409ee56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:14.118034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea518d0c-4d3a-49d8-a913-83693409ee56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:14.258455 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea518d0c-4d3a-49d8-a913-83693409ee56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:14.270377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea518d0c-4d3a-49d8-a913-83693409ee56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.173751 Jul 04 06:11:14.271169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 753/1499] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:14 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:15.292284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9379ccdc-2718-4fd7-91a9-370d678feaf2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:15.293330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9379ccdc-2718-4fd7-91a9-370d678feaf2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:15.301276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9379ccdc-2718-4fd7-91a9-370d678feaf2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:15.301720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9379ccdc-2718-4fd7-91a9-370d678feaf2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:15.302476 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9379ccdc-2718-4fd7-91a9-370d678feaf2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:15.302902 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9379ccdc-2718-4fd7-91a9-370d678feaf2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:15.435087 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9379ccdc-2718-4fd7-91a9-370d678feaf2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:15.443377 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9379ccdc-2718-4fd7-91a9-370d678feaf2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.157524 Jul 04 06:11:15.443942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 747/1500] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:15 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:16.467921 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0eefb558-c18c-4812-bcf2-32a4e9c4b7ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:16.468540 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0eefb558-c18c-4812-bcf2-32a4e9c4b7ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:16.475566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0eefb558-c18c-4812-bcf2-32a4e9c4b7ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:16.476045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0eefb558-c18c-4812-bcf2-32a4e9c4b7ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:16.476793 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0eefb558-c18c-4812-bcf2-32a4e9c4b7ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:16.477234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0eefb558-c18c-4812-bcf2-32a4e9c4b7ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:16.621238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0eefb558-c18c-4812-bcf2-32a4e9c4b7ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:16.630344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0eefb558-c18c-4812-bcf2-32a4e9c4b7ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168960 Jul 04 06:11:16.630981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 754/1501] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:16 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:17.649700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55a58199-1e94-4e53-9cf1-e0d31a2762ab tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:17.650518 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-55a58199-1e94-4e53-9cf1-e0d31a2762ab tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:17.660611 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a58199-1e94-4e53-9cf1-e0d31a2762ab tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:17.661261 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a58199-1e94-4e53-9cf1-e0d31a2762ab tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:17.662354 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a58199-1e94-4e53-9cf1-e0d31a2762ab tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:17.662978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a58199-1e94-4e53-9cf1-e0d31a2762ab tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:17.803192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-55a58199-1e94-4e53-9cf1-e0d31a2762ab tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:17.811636 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-55a58199-1e94-4e53-9cf1-e0d31a2762ab tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167323 Jul 04 06:11:17.812218 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 748/1502] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:17 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:18.834625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-137c7a96-7aac-489d-ad97-9ecdb6322548 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:18.835685 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-137c7a96-7aac-489d-ad97-9ecdb6322548 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:18.845504 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-137c7a96-7aac-489d-ad97-9ecdb6322548 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:18.845935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-137c7a96-7aac-489d-ad97-9ecdb6322548 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:18.846666 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-137c7a96-7aac-489d-ad97-9ecdb6322548 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:18.847102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-137c7a96-7aac-489d-ad97-9ecdb6322548 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:18.984185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-137c7a96-7aac-489d-ad97-9ecdb6322548 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:18.992370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-137c7a96-7aac-489d-ad97-9ecdb6322548 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164236 Jul 04 06:11:18.992944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 755/1503] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:18 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:20.009067 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6b238e1b-7134-4cc1-aca2-82dc7cae1336 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:20.009768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6b238e1b-7134-4cc1-aca2-82dc7cae1336 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:20.016389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b238e1b-7134-4cc1-aca2-82dc7cae1336 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:20.016926 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b238e1b-7134-4cc1-aca2-82dc7cae1336 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:20.017782 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b238e1b-7134-4cc1-aca2-82dc7cae1336 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:20.018215 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b238e1b-7134-4cc1-aca2-82dc7cae1336 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:20.156483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b238e1b-7134-4cc1-aca2-82dc7cae1336 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:20.166461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6b238e1b-7134-4cc1-aca2-82dc7cae1336 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.161446 Jul 04 06:11:20.167387 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 749/1504] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:20 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:21.187768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-07095b26-a601-40de-aa99-d694c76efdd0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:21.188788 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-07095b26-a601-40de-aa99-d694c76efdd0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:21.199717 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07095b26-a601-40de-aa99-d694c76efdd0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:21.200472 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07095b26-a601-40de-aa99-d694c76efdd0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:21.201722 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07095b26-a601-40de-aa99-d694c76efdd0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:21.202441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07095b26-a601-40de-aa99-d694c76efdd0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:21.342675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-07095b26-a601-40de-aa99-d694c76efdd0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:21.351212 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-07095b26-a601-40de-aa99-d694c76efdd0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170076 Jul 04 06:11:21.351831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 756/1505] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:21 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:22.372498 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9187c089-8871-418e-9c94-8d81e5f39d9e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:22.373402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9187c089-8871-418e-9c94-8d81e5f39d9e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:22.381549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9187c089-8871-418e-9c94-8d81e5f39d9e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:22.382002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9187c089-8871-418e-9c94-8d81e5f39d9e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:22.382775 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9187c089-8871-418e-9c94-8d81e5f39d9e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:22.383190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9187c089-8871-418e-9c94-8d81e5f39d9e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:22.754189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9187c089-8871-418e-9c94-8d81e5f39d9e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:22.762556 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9187c089-8871-418e-9c94-8d81e5f39d9e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.396718 Jul 04 06:11:22.763124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 750/1506] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:22 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:23.784083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e680afa-b159-4836-a68b-77801f6d6927 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:23.784783 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7e680afa-b159-4836-a68b-77801f6d6927 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:23.793184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e680afa-b159-4836-a68b-77801f6d6927 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:23.793749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e680afa-b159-4836-a68b-77801f6d6927 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:23.794698 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e680afa-b159-4836-a68b-77801f6d6927 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:23.795279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e680afa-b159-4836-a68b-77801f6d6927 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:23.927566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e680afa-b159-4836-a68b-77801f6d6927 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:23.935781 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7e680afa-b159-4836-a68b-77801f6d6927 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158351 Jul 04 06:11:23.936325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 757/1507] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:23 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:24.956600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4d26481c-2d49-4ae3-8b66-609eaaeb761f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:24.957253 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4d26481c-2d49-4ae3-8b66-609eaaeb761f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:24.964206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d26481c-2d49-4ae3-8b66-609eaaeb761f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:24.964652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d26481c-2d49-4ae3-8b66-609eaaeb761f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:24.965411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d26481c-2d49-4ae3-8b66-609eaaeb761f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:24.965836 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d26481c-2d49-4ae3-8b66-609eaaeb761f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:25.105560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d26481c-2d49-4ae3-8b66-609eaaeb761f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:25.114240 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4d26481c-2d49-4ae3-8b66-609eaaeb761f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163543 Jul 04 06:11:25.114805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 751/1508] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:24 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:26.132174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6f4561d1-c723-463c-8d09-f34f58f4aaf9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:26.132905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6f4561d1-c723-463c-8d09-f34f58f4aaf9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:26.140172 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f4561d1-c723-463c-8d09-f34f58f4aaf9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:26.140619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f4561d1-c723-463c-8d09-f34f58f4aaf9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:26.141386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f4561d1-c723-463c-8d09-f34f58f4aaf9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:26.141822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f4561d1-c723-463c-8d09-f34f58f4aaf9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:26.280674 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6f4561d1-c723-463c-8d09-f34f58f4aaf9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:26.289292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6f4561d1-c723-463c-8d09-f34f58f4aaf9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.161077 Jul 04 06:11:26.289891 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 758/1509] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:26 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:27.310810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-745b612c-53e2-46ff-84d6-c1f6dc34f28d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:27.311870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-745b612c-53e2-46ff-84d6-c1f6dc34f28d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:27.322831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-745b612c-53e2-46ff-84d6-c1f6dc34f28d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:27.323599 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-745b612c-53e2-46ff-84d6-c1f6dc34f28d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:27.324923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-745b612c-53e2-46ff-84d6-c1f6dc34f28d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:27.325766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-745b612c-53e2-46ff-84d6-c1f6dc34f28d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:27.462101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-745b612c-53e2-46ff-84d6-c1f6dc34f28d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:27.470326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-745b612c-53e2-46ff-84d6-c1f6dc34f28d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.166120 Jul 04 06:11:27.470970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 752/1510] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:27 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:28.487868 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b2219f8c-fd0f-44bb-a8d9-91185409c840 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:28.488462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b2219f8c-fd0f-44bb-a8d9-91185409c840 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:28.494953 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2219f8c-fd0f-44bb-a8d9-91185409c840 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:28.495431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2219f8c-fd0f-44bb-a8d9-91185409c840 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:28.496198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2219f8c-fd0f-44bb-a8d9-91185409c840 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:28.496636 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2219f8c-fd0f-44bb-a8d9-91185409c840 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:28.638496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b2219f8c-fd0f-44bb-a8d9-91185409c840 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:28.647119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b2219f8c-fd0f-44bb-a8d9-91185409c840 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163347 Jul 04 06:11:28.647727 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 759/1511] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:28 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:29.667225 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0e6f4bf-5753-4a01-a579-2956e3fcb714 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:29.667913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f0e6f4bf-5753-4a01-a579-2956e3fcb714 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:29.670938 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=26 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:11:29.677023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0e6f4bf-5753-4a01-a579-2956e3fcb714 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:29.677470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0e6f4bf-5753-4a01-a579-2956e3fcb714 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:29.678232 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0e6f4bf-5753-4a01-a579-2956e3fcb714 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:29.678661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0e6f4bf-5753-4a01-a579-2956e3fcb714 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:29.681408 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=78 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:11:29.814070 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f0e6f4bf-5753-4a01-a579-2956e3fcb714 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:29.823009 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f0e6f4bf-5753-4a01-a579-2956e3fcb714 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.161697 Jul 04 06:11:29.823650 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 753/1512] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:29 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:30.844930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-90e47866-1cec-4599-84f0-735b996db7cf tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:30.845841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-90e47866-1cec-4599-84f0-735b996db7cf tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:30.857519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90e47866-1cec-4599-84f0-735b996db7cf tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:30.858276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90e47866-1cec-4599-84f0-735b996db7cf tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:30.859573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90e47866-1cec-4599-84f0-735b996db7cf tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:30.860282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90e47866-1cec-4599-84f0-735b996db7cf tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:31.007994 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-90e47866-1cec-4599-84f0-735b996db7cf tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:31.018035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-90e47866-1cec-4599-84f0-735b996db7cf tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.179857 Jul 04 06:11:31.018590 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 760/1513] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:30 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:32.043538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-14ffa7b7-0611-49bc-a1dd-9f981d82bf4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:32.044503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-14ffa7b7-0611-49bc-a1dd-9f981d82bf4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:32.055575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14ffa7b7-0611-49bc-a1dd-9f981d82bf4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:32.056321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14ffa7b7-0611-49bc-a1dd-9f981d82bf4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:32.057578 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14ffa7b7-0611-49bc-a1dd-9f981d82bf4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:32.058294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14ffa7b7-0611-49bc-a1dd-9f981d82bf4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:32.198855 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-14ffa7b7-0611-49bc-a1dd-9f981d82bf4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:32.211492 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-14ffa7b7-0611-49bc-a1dd-9f981d82bf4c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.174095 Jul 04 06:11:32.212268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 754/1514] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:32 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:33.233598 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6606967a-c51f-4777-9d1d-4d2cb64eca59 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:33.234642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6606967a-c51f-4777-9d1d-4d2cb64eca59 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:33.237926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=26 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:11:33.243406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6606967a-c51f-4777-9d1d-4d2cb64eca59 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:33.243844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6606967a-c51f-4777-9d1d-4d2cb64eca59 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:33.244599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6606967a-c51f-4777-9d1d-4d2cb64eca59 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:33.245022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6606967a-c51f-4777-9d1d-4d2cb64eca59 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:33.247696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=78 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:11:33.376551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6606967a-c51f-4777-9d1d-4d2cb64eca59 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:33.384948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6606967a-c51f-4777-9d1d-4d2cb64eca59 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158089 Jul 04 06:11:33.385527 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 761/1515] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:33 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:34.404755 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-583b2b90-b2ae-4800-baff-2ca52d6d5c80 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:34.405887 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-583b2b90-b2ae-4800-baff-2ca52d6d5c80 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:34.413660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-583b2b90-b2ae-4800-baff-2ca52d6d5c80 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:34.414113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-583b2b90-b2ae-4800-baff-2ca52d6d5c80 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:34.414882 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-583b2b90-b2ae-4800-baff-2ca52d6d5c80 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:34.415351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-583b2b90-b2ae-4800-baff-2ca52d6d5c80 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:34.547520 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-583b2b90-b2ae-4800-baff-2ca52d6d5c80 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:34.555721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-583b2b90-b2ae-4800-baff-2ca52d6d5c80 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156030 Jul 04 06:11:34.556287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 755/1516] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:34 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:35.578473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e245018c-73a8-4d37-8d12-bcd6d5024f3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:35.579714 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e245018c-73a8-4d37-8d12-bcd6d5024f3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:35.586634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e245018c-73a8-4d37-8d12-bcd6d5024f3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:35.587077 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e245018c-73a8-4d37-8d12-bcd6d5024f3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:35.587873 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e245018c-73a8-4d37-8d12-bcd6d5024f3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:35.588302 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e245018c-73a8-4d37-8d12-bcd6d5024f3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:35.727370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e245018c-73a8-4d37-8d12-bcd6d5024f3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:35.740379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e245018c-73a8-4d37-8d12-bcd6d5024f3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168039 Jul 04 06:11:35.741330 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 762/1517] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:35 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:36.766312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0e03c463-647d-43e5-af69-d8ff6393d54b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:36.767223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0e03c463-647d-43e5-af69-d8ff6393d54b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:36.778672 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e03c463-647d-43e5-af69-d8ff6393d54b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:36.779504 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e03c463-647d-43e5-af69-d8ff6393d54b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:36.781166 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e03c463-647d-43e5-af69-d8ff6393d54b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:36.781850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e03c463-647d-43e5-af69-d8ff6393d54b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:36.922147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0e03c463-647d-43e5-af69-d8ff6393d54b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:36.930514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0e03c463-647d-43e5-af69-d8ff6393d54b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170805 Jul 04 06:11:36.931084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 756/1518] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:36 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:37.951824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a298629a-fe51-48c9-b7aa-02216c72de36 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:37.952813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a298629a-fe51-48c9-b7aa-02216c72de36 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:37.964170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a298629a-fe51-48c9-b7aa-02216c72de36 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:37.964916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a298629a-fe51-48c9-b7aa-02216c72de36 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:37.966151 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a298629a-fe51-48c9-b7aa-02216c72de36 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:37.966909 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a298629a-fe51-48c9-b7aa-02216c72de36 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:38.103275 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a298629a-fe51-48c9-b7aa-02216c72de36 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:38.111834 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a298629a-fe51-48c9-b7aa-02216c72de36 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.166214 Jul 04 06:11:38.112165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 763/1519] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:37 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:39.128281 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b6c8bb6f-af97-459f-91cb-7815fe661a92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:39.128898 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b6c8bb6f-af97-459f-91cb-7815fe661a92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:39.135560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6c8bb6f-af97-459f-91cb-7815fe661a92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:39.136009 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6c8bb6f-af97-459f-91cb-7815fe661a92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:39.136780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6c8bb6f-af97-459f-91cb-7815fe661a92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:39.137214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6c8bb6f-af97-459f-91cb-7815fe661a92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:39.271671 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b6c8bb6f-af97-459f-91cb-7815fe661a92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:39.284647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b6c8bb6f-af97-459f-91cb-7815fe661a92 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.160057 Jul 04 06:11:39.285440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 757/1520] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:39 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:40.311432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f5be6469-954e-4f79-af9b-47058d0ac456 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:40.312552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f5be6469-954e-4f79-af9b-47058d0ac456 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:40.320482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5be6469-954e-4f79-af9b-47058d0ac456 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:40.320926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5be6469-954e-4f79-af9b-47058d0ac456 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:40.321689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5be6469-954e-4f79-af9b-47058d0ac456 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:40.322115 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5be6469-954e-4f79-af9b-47058d0ac456 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:40.459054 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f5be6469-954e-4f79-af9b-47058d0ac456 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:40.467432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f5be6469-954e-4f79-af9b-47058d0ac456 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162477 Jul 04 06:11:40.468020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 764/1521] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:40 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:41.488737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7bb4297d-a316-4ae9-9c83-a4a58d901c26 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:41.489460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7bb4297d-a316-4ae9-9c83-a4a58d901c26 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:41.497911 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bb4297d-a316-4ae9-9c83-a4a58d901c26 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:41.498499 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bb4297d-a316-4ae9-9c83-a4a58d901c26 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:41.499476 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bb4297d-a316-4ae9-9c83-a4a58d901c26 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:41.500030 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bb4297d-a316-4ae9-9c83-a4a58d901c26 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:41.642612 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7bb4297d-a316-4ae9-9c83-a4a58d901c26 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:41.651136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7bb4297d-a316-4ae9-9c83-a4a58d901c26 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168876 Jul 04 06:11:41.651703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 758/1522] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:41 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:42.672761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8d29ec36-5b11-45f8-aa95-36eefa48150a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:42.673737 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8d29ec36-5b11-45f8-aa95-36eefa48150a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:42.684960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d29ec36-5b11-45f8-aa95-36eefa48150a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:42.685701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d29ec36-5b11-45f8-aa95-36eefa48150a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:42.686989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d29ec36-5b11-45f8-aa95-36eefa48150a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:42.687743 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d29ec36-5b11-45f8-aa95-36eefa48150a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:42.821580 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8d29ec36-5b11-45f8-aa95-36eefa48150a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:42.830056 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8d29ec36-5b11-45f8-aa95-36eefa48150a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163856 Jul 04 06:11:42.830662 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 765/1523] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:42 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:43.851774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-103535c8-0ed5-49e9-b41a-e0777e0724d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:43.852709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-103535c8-0ed5-49e9-b41a-e0777e0724d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:43.863418 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-103535c8-0ed5-49e9-b41a-e0777e0724d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:43.863884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-103535c8-0ed5-49e9-b41a-e0777e0724d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:43.864645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-103535c8-0ed5-49e9-b41a-e0777e0724d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:43.865082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-103535c8-0ed5-49e9-b41a-e0777e0724d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:44.016832 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-103535c8-0ed5-49e9-b41a-e0777e0724d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:44.029531 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-103535c8-0ed5-49e9-b41a-e0777e0724d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.184046 Jul 04 06:11:44.030660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 759/1524] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:43 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:45.052613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0b78416-76b5-49f1-98a1-17363660706d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:45.053413 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0b78416-76b5-49f1-98a1-17363660706d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:45.062491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0b78416-76b5-49f1-98a1-17363660706d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:45.063096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0b78416-76b5-49f1-98a1-17363660706d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:45.064156 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0b78416-76b5-49f1-98a1-17363660706d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:45.064735 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0b78416-76b5-49f1-98a1-17363660706d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:45.209196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f0b78416-76b5-49f1-98a1-17363660706d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:45.217546 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0b78416-76b5-49f1-98a1-17363660706d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.171198 Jul 04 06:11:45.218088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 766/1525] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:45 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:46.239529 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-900084dc-d9a6-4c7b-9006-f12cda67d87a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:46.240515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-900084dc-d9a6-4c7b-9006-f12cda67d87a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:46.251514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-900084dc-d9a6-4c7b-9006-f12cda67d87a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:46.252268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-900084dc-d9a6-4c7b-9006-f12cda67d87a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:46.253605 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-900084dc-d9a6-4c7b-9006-f12cda67d87a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:46.254038 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-900084dc-d9a6-4c7b-9006-f12cda67d87a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:46.388078 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-900084dc-d9a6-4c7b-9006-f12cda67d87a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:46.400980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-900084dc-d9a6-4c7b-9006-f12cda67d87a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167966 Jul 04 06:11:46.401982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 760/1526] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:46 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:47.426187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7a7467d9-d48b-4853-9da1-797871d5d597 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:47.427021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7a7467d9-d48b-4853-9da1-797871d5d597 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:47.436029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a7467d9-d48b-4853-9da1-797871d5d597 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:47.436703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a7467d9-d48b-4853-9da1-797871d5d597 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:47.437708 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a7467d9-d48b-4853-9da1-797871d5d597 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:47.438283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a7467d9-d48b-4853-9da1-797871d5d597 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:47.591266 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7a7467d9-d48b-4853-9da1-797871d5d597 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:47.600097 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7a7467d9-d48b-4853-9da1-797871d5d597 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.180425 Jul 04 06:11:47.601078 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 767/1527] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:47 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:48.617401 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d282468-e48e-4cbf-bd86-a2e5f455e2e9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:48.618027 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d282468-e48e-4cbf-bd86-a2e5f455e2e9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:48.625209 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d282468-e48e-4cbf-bd86-a2e5f455e2e9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:48.625743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d282468-e48e-4cbf-bd86-a2e5f455e2e9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:48.626550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d282468-e48e-4cbf-bd86-a2e5f455e2e9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:48.626993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d282468-e48e-4cbf-bd86-a2e5f455e2e9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:48.766974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d282468-e48e-4cbf-bd86-a2e5f455e2e9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:48.776142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d282468-e48e-4cbf-bd86-a2e5f455e2e9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162601 Jul 04 06:11:48.776707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 761/1528] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:48 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:49.793822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e19d359a-f6e0-4ce4-8540-7c32646515b5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:49.794552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e19d359a-f6e0-4ce4-8540-7c32646515b5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:49.801475 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e19d359a-f6e0-4ce4-8540-7c32646515b5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:49.801920 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e19d359a-f6e0-4ce4-8540-7c32646515b5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:49.802690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e19d359a-f6e0-4ce4-8540-7c32646515b5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:49.803124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e19d359a-f6e0-4ce4-8540-7c32646515b5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:49.939598 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e19d359a-f6e0-4ce4-8540-7c32646515b5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:49.949355 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e19d359a-f6e0-4ce4-8540-7c32646515b5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159428 Jul 04 06:11:49.949935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 768/1529] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:49 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:50.888670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-59a36239-4db3-4c8f-a82a-7e136c976bdc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:50.889214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-59a36239-4db3-4c8f-a82a-7e136c976bdc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:50.895908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59a36239-4db3-4c8f-a82a-7e136c976bdc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:50.896364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59a36239-4db3-4c8f-a82a-7e136c976bdc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:50.897137 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59a36239-4db3-4c8f-a82a-7e136c976bdc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:50.897598 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59a36239-4db3-4c8f-a82a-7e136c976bdc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:50.927279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-59a36239-4db3-4c8f-a82a-7e136c976bdc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:11:50.967112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e2ee57ef-1569-44ee-a28c-04198ce1e853 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:50.967720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e2ee57ef-1569-44ee-a28c-04198ce1e853 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:50.974405 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2ee57ef-1569-44ee-a28c-04198ce1e853 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:50.974857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2ee57ef-1569-44ee-a28c-04198ce1e853 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:50.975801 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2ee57ef-1569-44ee-a28c-04198ce1e853 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:50.976240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2ee57ef-1569-44ee-a28c-04198ce1e853 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:51.017885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-59a36239-4db3-4c8f-a82a-7e136c976bdc tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 204 len: 0 microversion: 2.1 time: 0.132718 Jul 04 06:11:51.018817 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 762/1530] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:11:50 2022] DELETE /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 06:11:51.032887 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-de95befc-501e-48ec-b1b6-0b6c2c1a8e0a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:51.033722 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-de95befc-501e-48ec-b1b6-0b6c2c1a8e0a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:51.040403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de95befc-501e-48ec-b1b6-0b6c2c1a8e0a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:51.040860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de95befc-501e-48ec-b1b6-0b6c2c1a8e0a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:51.041638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de95befc-501e-48ec-b1b6-0b6c2c1a8e0a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:51.042071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de95befc-501e-48ec-b1b6-0b6c2c1a8e0a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:51.112295 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e2ee57ef-1569-44ee-a28c-04198ce1e853 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:51.120967 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e2ee57ef-1569-44ee-a28c-04198ce1e853 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.157676 Jul 04 06:11:51.121393 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 769/1531] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:50 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:11:51.173034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-de95befc-501e-48ec-b1b6-0b6c2c1a8e0a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:51.180633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-de95befc-501e-48ec-b1b6-0b6c2c1a8e0a tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 200 len: 1681 microversion: 2.1 time: 0.157480 Jul 04 06:11:51.181190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 763/1532] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:51 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:11:52.137913 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c764124-ea9d-40ba-8c98-eac084330fa9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:52.138493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2c764124-ea9d-40ba-8c98-eac084330fa9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:52.145322 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c764124-ea9d-40ba-8c98-eac084330fa9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:52.145762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c764124-ea9d-40ba-8c98-eac084330fa9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:52.146516 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c764124-ea9d-40ba-8c98-eac084330fa9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:52.146941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c764124-ea9d-40ba-8c98-eac084330fa9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:52.198632 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fbcdb35b-138f-460d-bb62-050beb821cc6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:52.199381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fbcdb35b-138f-460d-bb62-050beb821cc6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:52.207599 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbcdb35b-138f-460d-bb62-050beb821cc6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:52.208127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbcdb35b-138f-460d-bb62-050beb821cc6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:52.208969 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbcdb35b-138f-460d-bb62-050beb821cc6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:52.209499 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbcdb35b-138f-460d-bb62-050beb821cc6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:52.274672 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fbcdb35b-138f-460d-bb62-050beb821cc6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367c76dfa7f4d2791e60ce148f352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e16375231df4b768b8355e320e91731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:52.289131 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fbcdb35b-138f-460d-bb62-050beb821cc6 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 200 len: 1613 microversion: 2.1 time: 0.094350 Jul 04 06:11:52.290140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 764/1533] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:52 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 1613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:52.344762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c764124-ea9d-40ba-8c98-eac084330fa9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:52.356818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2c764124-ea9d-40ba-8c98-eac084330fa9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.221812 Jul 04 06:11:52.358160 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 770/1534] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:52 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:52.489206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a1793996-3310-410e-9fc3-88621d6bcfc5 req-121227ed-549d-4064-b49c-42db630f1f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6fb72d-5a19-43fb-9fa5-b630aa555080", "name": "network-vif-deleted", "tag": "b4adbb43-6f52-4a85-9b6e-f559845cec1e"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:11:52.506954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a1793996-3310-410e-9fc3-88621d6bcfc5 req-121227ed-549d-4064-b49c-42db630f1f47 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:52.507451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a1793996-3310-410e-9fc3-88621d6bcfc5 req-121227ed-549d-4064-b49c-42db630f1f47 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:52.527540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a1793996-3310-410e-9fc3-88621d6bcfc5 req-121227ed-549d-4064-b49c-42db630f1f47 service nova] Creating event network-vif-deleted:b4adbb43-6f52-4a85-9b6e-f559845cec1e for instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 on hv-cinder-79733 Jul 04 06:11:52.532561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a1793996-3310-410e-9fc3-88621d6bcfc5 req-121227ed-549d-4064-b49c-42db630f1f47 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226651 Jul 04 06:11:52.533148 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 765/1535] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:11:53.306185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-086b00f3-10e5-4f3a-aa49-236599e21f37 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:53.306914 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-086b00f3-10e5-4f3a-aa49-236599e21f37 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:53.313925 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-086b00f3-10e5-4f3a-aa49-236599e21f37 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:53.314486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-086b00f3-10e5-4f3a-aa49-236599e21f37 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:53.315241 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-086b00f3-10e5-4f3a-aa49-236599e21f37 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:53.315714 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-086b00f3-10e5-4f3a-aa49-236599e21f37 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:53.329822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-086b00f3-10e5-4f3a-aa49-236599e21f37 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-086b00f3-10e5-4f3a-aa49-236599e21f37 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 HTTP/1.1 Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 06:11:53.331612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:11:53.333423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '5e6fb72d-5a19-43fb-9fa5-b630aa555080'} Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:11:53.337915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:11:53.339720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:11:53.341222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-086b00f3-10e5-4f3a-aa49-236599e21f37 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:11:53.341222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-086b00f3-10e5-4f3a-aa49-236599e21f37 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 404 len: 111 microversion: 2.1 time: 0.030833 Jul 04 06:11:53.341222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 771/1536] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:53 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:11:53.344006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8010d01c-3485-45e0-842f-1c2b409a3bb9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '.version_select at 0x7f20477dcd30>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:53.366558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8010d01c-3485-45e0-842f-1c2b409a3bb9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-539974468" status: 202 len: 0 microversion: 2.1 time: 0.027763 Jul 04 06:11:53.367141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 766/1537] 10.222.0.42 () {58 vars in 1217 bytes} [Mon Jul 4 06:11:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-539974468 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:11:53.374131 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2f9bfddc-ee53-4c3e-bdea-2834862b4032 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:53.374750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2f9bfddc-ee53-4c3e-bdea-2834862b4032 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:53.381244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f9bfddc-ee53-4c3e-bdea-2834862b4032 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:53.381701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f9bfddc-ee53-4c3e-bdea-2834862b4032 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:53.382480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f9bfddc-ee53-4c3e-bdea-2834862b4032 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:53.382915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f9bfddc-ee53-4c3e-bdea-2834862b4032 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:53.562052 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2f9bfddc-ee53-4c3e-bdea-2834862b4032 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:53.573305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2f9bfddc-ee53-4c3e-bdea-2834862b4032 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.202984 Jul 04 06:11:53.574068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 772/1538] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:53 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:54.595542 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8d9df798-898f-41fd-b935-f7854af745b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:54.596740 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8d9df798-898f-41fd-b935-f7854af745b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:54.605150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d9df798-898f-41fd-b935-f7854af745b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:54.605598 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d9df798-898f-41fd-b935-f7854af745b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:54.606403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d9df798-898f-41fd-b935-f7854af745b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:54.606840 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d9df798-898f-41fd-b935-f7854af745b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:54.750279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d9df798-898f-41fd-b935-f7854af745b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:54.761580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8d9df798-898f-41fd-b935-f7854af745b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.173628 Jul 04 06:11:54.762189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 767/1539] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:54 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:55.783172 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c84870b2-9b09-448c-abcd-f196e9b920cd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:55.784126 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c84870b2-9b09-448c-abcd-f196e9b920cd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:55.795062 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c84870b2-9b09-448c-abcd-f196e9b920cd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:55.795860 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c84870b2-9b09-448c-abcd-f196e9b920cd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:55.797113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c84870b2-9b09-448c-abcd-f196e9b920cd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:55.797832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c84870b2-9b09-448c-abcd-f196e9b920cd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:55.939124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c84870b2-9b09-448c-abcd-f196e9b920cd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:55.947331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c84870b2-9b09-448c-abcd-f196e9b920cd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.171058 Jul 04 06:11:55.947900 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 773/1540] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:55 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:56.973835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe020388-e05b-4a61-a0da-9fc2495cdcd4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:56.974948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe020388-e05b-4a61-a0da-9fc2495cdcd4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:56.986101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe020388-e05b-4a61-a0da-9fc2495cdcd4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:56.986823 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe020388-e05b-4a61-a0da-9fc2495cdcd4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:56.988189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe020388-e05b-4a61-a0da-9fc2495cdcd4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:56.988914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe020388-e05b-4a61-a0da-9fc2495cdcd4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:57.122700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe020388-e05b-4a61-a0da-9fc2495cdcd4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:57.131521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe020388-e05b-4a61-a0da-9fc2495cdcd4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164154 Jul 04 06:11:57.141415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 768/1541] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:56 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:58.150671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8701cefd-a84d-437c-af68-0d019e73c00b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:58.151362 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8701cefd-a84d-437c-af68-0d019e73c00b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:58.160322 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8701cefd-a84d-437c-af68-0d019e73c00b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:58.160855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8701cefd-a84d-437c-af68-0d019e73c00b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:58.162041 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8701cefd-a84d-437c-af68-0d019e73c00b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:58.162586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8701cefd-a84d-437c-af68-0d019e73c00b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:58.296119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8701cefd-a84d-437c-af68-0d019e73c00b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:58.304236 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8701cefd-a84d-437c-af68-0d019e73c00b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159348 Jul 04 06:11:58.304805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 774/1542] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:58 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:11:59.324327 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f8855c0e-4a7b-4a7b-a2de-d691f3084c7d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:11:59.331318 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f8855c0e-4a7b-4a7b-a2de-d691f3084c7d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:11:59.339523 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8855c0e-4a7b-4a7b-a2de-d691f3084c7d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:59.339974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8855c0e-4a7b-4a7b-a2de-d691f3084c7d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:59.340767 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8855c0e-4a7b-4a7b-a2de-d691f3084c7d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:11:59.341503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8855c0e-4a7b-4a7b-a2de-d691f3084c7d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:11:59.508522 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f8855c0e-4a7b-4a7b-a2de-d691f3084c7d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:11:59.510843 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:11:59.519340 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f8855c0e-4a7b-4a7b-a2de-d691f3084c7d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.199105 Jul 04 06:11:59.519952 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 769/1543] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:11:59 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:00.536903 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-17126477-d46e-4db8-b844-11d849e54140 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:00.537478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-17126477-d46e-4db8-b844-11d849e54140 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:00.544195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17126477-d46e-4db8-b844-11d849e54140 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:00.544636 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17126477-d46e-4db8-b844-11d849e54140 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:00.545383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17126477-d46e-4db8-b844-11d849e54140 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:00.545805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17126477-d46e-4db8-b844-11d849e54140 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:00.682510 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-17126477-d46e-4db8-b844-11d849e54140 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:00.690769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-17126477-d46e-4db8-b844-11d849e54140 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.157706 Jul 04 06:12:00.691368 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 775/1544] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:00 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:01.717908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7322b7a5-98ae-42a1-bfcb-80a9c16a1af3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:01.718802 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7322b7a5-98ae-42a1-bfcb-80a9c16a1af3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:01.722955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:12:01.732783 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7322b7a5-98ae-42a1-bfcb-80a9c16a1af3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:01.733527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7322b7a5-98ae-42a1-bfcb-80a9c16a1af3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:01.734791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7322b7a5-98ae-42a1-bfcb-80a9c16a1af3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:01.735571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7322b7a5-98ae-42a1-bfcb-80a9c16a1af3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:01.877053 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7322b7a5-98ae-42a1-bfcb-80a9c16a1af3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:01.885460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7322b7a5-98ae-42a1-bfcb-80a9c16a1af3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.174455 Jul 04 06:12:01.886029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 770/1545] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:01 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:02.907051 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-efd8145a-d9f6-462f-a67c-2ed0995a4bb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:02.907875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-efd8145a-d9f6-462f-a67c-2ed0995a4bb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:02.916902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efd8145a-d9f6-462f-a67c-2ed0995a4bb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:02.917354 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efd8145a-d9f6-462f-a67c-2ed0995a4bb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:02.918120 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efd8145a-d9f6-462f-a67c-2ed0995a4bb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:02.918557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efd8145a-d9f6-462f-a67c-2ed0995a4bb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:03.058426 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-efd8145a-d9f6-462f-a67c-2ed0995a4bb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:03.066566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-efd8145a-d9f6-462f-a67c-2ed0995a4bb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.166420 Jul 04 06:12:03.067159 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 776/1546] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:02 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:04.087916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e306024-5981-40d9-9c4e-db3ca0be386b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:04.088902 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9e306024-5981-40d9-9c4e-db3ca0be386b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:04.100041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e306024-5981-40d9-9c4e-db3ca0be386b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:04.100844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e306024-5981-40d9-9c4e-db3ca0be386b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:04.102246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e306024-5981-40d9-9c4e-db3ca0be386b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:04.102675 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e306024-5981-40d9-9c4e-db3ca0be386b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:04.237433 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9e306024-5981-40d9-9c4e-db3ca0be386b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:04.245604 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e306024-5981-40d9-9c4e-db3ca0be386b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164301 Jul 04 06:12:04.246180 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 771/1547] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:04 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:05.265330 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-abd19841-4265-4047-9dad-d5a3801d0724 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:05.266091 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-abd19841-4265-4047-9dad-d5a3801d0724 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:05.268537 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=32 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:12:05.276043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abd19841-4265-4047-9dad-d5a3801d0724 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:05.276487 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abd19841-4265-4047-9dad-d5a3801d0724 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:05.277246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abd19841-4265-4047-9dad-d5a3801d0724 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:05.277680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abd19841-4265-4047-9dad-d5a3801d0724 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:05.280818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=92 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:12:05.423597 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-abd19841-4265-4047-9dad-d5a3801d0724 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:05.432032 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-abd19841-4265-4047-9dad-d5a3801d0724 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.171818 Jul 04 06:12:05.432613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 777/1548] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:05 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:06.451826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75d28e49-2235-4ce2-a4a1-9810391f335c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:06.452600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-75d28e49-2235-4ce2-a4a1-9810391f335c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:06.461645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75d28e49-2235-4ce2-a4a1-9810391f335c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:06.462263 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75d28e49-2235-4ce2-a4a1-9810391f335c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:06.463386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75d28e49-2235-4ce2-a4a1-9810391f335c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:06.463946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75d28e49-2235-4ce2-a4a1-9810391f335c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:06.599099 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-75d28e49-2235-4ce2-a4a1-9810391f335c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:06.607368 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-75d28e49-2235-4ce2-a4a1-9810391f335c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.160820 Jul 04 06:12:06.607911 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 772/1549] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:06 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:07.625145 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-06cbd405-dd49-45ae-8422-e3eca649b81a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:07.626385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-06cbd405-dd49-45ae-8422-e3eca649b81a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:07.632761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06cbd405-dd49-45ae-8422-e3eca649b81a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:07.633196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06cbd405-dd49-45ae-8422-e3eca649b81a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:07.634244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06cbd405-dd49-45ae-8422-e3eca649b81a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:07.634397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06cbd405-dd49-45ae-8422-e3eca649b81a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:07.770265 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-06cbd405-dd49-45ae-8422-e3eca649b81a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:07.778396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-06cbd405-dd49-45ae-8422-e3eca649b81a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.157371 Jul 04 06:12:07.779153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 778/1550] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:07 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:08.796246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e273e6d4-176d-454b-8313-0c04cf1f1eb5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:08.796813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e273e6d4-176d-454b-8313-0c04cf1f1eb5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:08.803714 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e273e6d4-176d-454b-8313-0c04cf1f1eb5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:08.804164 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e273e6d4-176d-454b-8313-0c04cf1f1eb5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:08.804997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e273e6d4-176d-454b-8313-0c04cf1f1eb5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:08.805459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e273e6d4-176d-454b-8313-0c04cf1f1eb5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:08.949789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e273e6d4-176d-454b-8313-0c04cf1f1eb5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:08.958008 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e273e6d4-176d-454b-8313-0c04cf1f1eb5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165705 Jul 04 06:12:08.958576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 773/1551] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:08 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:09.977437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-99758677-0ec3-4753-9d37-e20b03d7f5ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:09.978057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-99758677-0ec3-4753-9d37-e20b03d7f5ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:09.983431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63fccdfd-6eb9-4132-84fb-eb45db2333e0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:09.984054 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63fccdfd-6eb9-4132-84fb-eb45db2333e0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:09.985443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99758677-0ec3-4753-9d37-e20b03d7f5ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:09.985884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99758677-0ec3-4753-9d37-e20b03d7f5ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:09.986860 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99758677-0ec3-4753-9d37-e20b03d7f5ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:09.987526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99758677-0ec3-4753-9d37-e20b03d7f5ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:09.990349 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63fccdfd-6eb9-4132-84fb-eb45db2333e0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:09.990773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63fccdfd-6eb9-4132-84fb-eb45db2333e0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:09.991730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63fccdfd-6eb9-4132-84fb-eb45db2333e0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:09.992319 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63fccdfd-6eb9-4132-84fb-eb45db2333e0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:10.006367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-63fccdfd-6eb9-4132-84fb-eb45db2333e0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] HTTP exception thrown: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63fccdfd-6eb9-4132-84fb-eb45db2333e0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Request method failure captured: Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 HTTP/1.1 Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoB8bKsJbNvGOnJjkpXV9bswTHj3lvwmYf__bTpxb2VlLNE2omAzkDjdRLHE1uFhHtcDQ1zYoQVE7lUvW_r_RK0AyDeSWrYbMF_qOnsoDGhYORcDduFofYuPv_uj9uZoyMIkGuP-AxfvlL4ICDPHroDYuGc-vuMdyYkjQJ4MJ96ufkc Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:12:10.008190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 982651a870c44a07bc4df322919e605e Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:12:10.018379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': 'a87fa4b2-597e-431a-bd5e-45f8c7395529'} Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:12:10.019620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:12:10.021608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:12:10.023294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63fccdfd-6eb9-4132-84fb-eb45db2333e0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Returning 404 to user: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:12:10.023294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63fccdfd-6eb9-4132-84fb-eb45db2333e0 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 404 len: 111 microversion: 2.20 time: 0.030011 Jul 04 06:12:10.023294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 774/1552] 10.222.0.42 () {60 vars in 1279 bytes} [Mon Jul 4 06:12:09 2022] DELETE /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 04 06:12:10.023294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dcf3f542-9049-4928-b1ff-bddc1ee34649 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:10.023294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dcf3f542-9049-4928-b1ff-bddc1ee34649 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: a87fa4b2-597e-431a-bd5e-45f8c7395529] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:10.024693 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcf3f542-9049-4928-b1ff-bddc1ee34649 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:10.025144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcf3f542-9049-4928-b1ff-bddc1ee34649 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:10.025936 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcf3f542-9049-4928-b1ff-bddc1ee34649 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:10.026370 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcf3f542-9049-4928-b1ff-bddc1ee34649 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:10.040549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-dcf3f542-9049-4928-b1ff-bddc1ee34649 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] HTTP exception thrown: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dcf3f542-9049-4928-b1ff-bddc1ee34649 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Request method failure captured: Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 HTTP/1.1 Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoB8bKsJbNvGOnJjkpXV9bswTHj3lvwmYf__bTpxb2VlLNE2omAzkDjdRLHE1uFhHtcDQ1zYoQVE7lUvW_r_RK0AyDeSWrYbMF_qOnsoDGhYORcDduFofYuPv_uj9uZoyMIkGuP-AxfvlL4ICDPHroDYuGc-vuMdyYkjQJ4MJ96ufkc Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:12:10.042176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 982651a870c44a07bc4df322919e605e Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:12:10.043848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': 'a87fa4b2-597e-431a-bd5e-45f8c7395529'} Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:12:10.044732 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. Jul 04 06:12:10.046183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:12:10.047434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dcf3f542-9049-4928-b1ff-bddc1ee34649 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Returning 404 to user: Instance a87fa4b2-597e-431a-bd5e-45f8c7395529 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:12:10.047434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dcf3f542-9049-4928-b1ff-bddc1ee34649 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529" status: 404 len: 111 microversion: 2.20 time: 0.029394 Jul 04 06:12:10.047434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 775/1553] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 06:12:10 2022] GET /compute/v2.1/servers/a87fa4b2-597e-431a-bd5e-45f8c7395529 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 04 06:12:10.122759 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-99758677-0ec3-4753-9d37-e20b03d7f5ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:10.132300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-99758677-0ec3-4753-9d37-e20b03d7f5ff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158310 Jul 04 06:12:10.132939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 779/1554] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:09 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:11.151200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-74faa1a9-fbc8-4689-9cba-47775fd4fdba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:11.151955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-74faa1a9-fbc8-4689-9cba-47775fd4fdba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:11.159405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-74faa1a9-fbc8-4689-9cba-47775fd4fdba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:11.159847 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-74faa1a9-fbc8-4689-9cba-47775fd4fdba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:11.160595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-74faa1a9-fbc8-4689-9cba-47775fd4fdba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:11.161031 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-74faa1a9-fbc8-4689-9cba-47775fd4fdba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:11.293000 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-74faa1a9-fbc8-4689-9cba-47775fd4fdba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:11.301283 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-74faa1a9-fbc8-4689-9cba-47775fd4fdba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.154116 Jul 04 06:12:11.301836 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 776/1555] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:11 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:12.321812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-efec61f1-f6d6-49d5-bf8f-8d6bf57c659d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:12.322789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-efec61f1-f6d6-49d5-bf8f-8d6bf57c659d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:12.330143 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efec61f1-f6d6-49d5-bf8f-8d6bf57c659d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:12.330592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efec61f1-f6d6-49d5-bf8f-8d6bf57c659d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:12.331389 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efec61f1-f6d6-49d5-bf8f-8d6bf57c659d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:12.331824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efec61f1-f6d6-49d5-bf8f-8d6bf57c659d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:12.465696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-efec61f1-f6d6-49d5-bf8f-8d6bf57c659d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:12.478483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-efec61f1-f6d6-49d5-bf8f-8d6bf57c659d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162886 Jul 04 06:12:12.479502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 780/1556] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:12 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:13.499340 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a18cc6a5-a0c3-45fc-b07a-9b064474421e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:13.500092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a18cc6a5-a0c3-45fc-b07a-9b064474421e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:13.508930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a18cc6a5-a0c3-45fc-b07a-9b064474421e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:13.509469 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a18cc6a5-a0c3-45fc-b07a-9b064474421e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:13.510444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a18cc6a5-a0c3-45fc-b07a-9b064474421e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:13.510993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a18cc6a5-a0c3-45fc-b07a-9b064474421e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:13.646233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a18cc6a5-a0c3-45fc-b07a-9b064474421e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:13.655236 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a18cc6a5-a0c3-45fc-b07a-9b064474421e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.161334 Jul 04 06:12:13.655841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 777/1557] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:13 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:14.676666 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e0bc84e9-a770-44e5-bcdc-59cfbd29ee98 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:14.677622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e0bc84e9-a770-44e5-bcdc-59cfbd29ee98 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:14.688760 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0bc84e9-a770-44e5-bcdc-59cfbd29ee98 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:14.689500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0bc84e9-a770-44e5-bcdc-59cfbd29ee98 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:14.690760 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0bc84e9-a770-44e5-bcdc-59cfbd29ee98 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:14.691533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e0bc84e9-a770-44e5-bcdc-59cfbd29ee98 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:14.831482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e0bc84e9-a770-44e5-bcdc-59cfbd29ee98 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:14.842378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e0bc84e9-a770-44e5-bcdc-59cfbd29ee98 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.172204 Jul 04 06:12:14.842964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 781/1558] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:14 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:15.864370 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-434d3035-344b-4dce-becf-a4c7c5af7fa5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:15.865248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-434d3035-344b-4dce-becf-a4c7c5af7fa5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:15.874288 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-434d3035-344b-4dce-becf-a4c7c5af7fa5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:15.874736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-434d3035-344b-4dce-becf-a4c7c5af7fa5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:15.875541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-434d3035-344b-4dce-becf-a4c7c5af7fa5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:15.875977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-434d3035-344b-4dce-becf-a4c7c5af7fa5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:16.026438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-434d3035-344b-4dce-becf-a4c7c5af7fa5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:16.040214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-434d3035-344b-4dce-becf-a4c7c5af7fa5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.182335 Jul 04 06:12:16.040985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 778/1559] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:15 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:17.063196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ae689486-8cd1-4e0f-af6b-06516095f7a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:17.064372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ae689486-8cd1-4e0f-af6b-06516095f7a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:17.075005 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae689486-8cd1-4e0f-af6b-06516095f7a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:17.075486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae689486-8cd1-4e0f-af6b-06516095f7a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:17.076243 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae689486-8cd1-4e0f-af6b-06516095f7a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:17.076809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae689486-8cd1-4e0f-af6b-06516095f7a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:17.218670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae689486-8cd1-4e0f-af6b-06516095f7a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:17.230639 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ae689486-8cd1-4e0f-af6b-06516095f7a9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.174268 Jul 04 06:12:17.231464 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 782/1560] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:17 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:18.247600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b099555a-2c3a-4bad-be9a-d313252129f8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:18.248439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b099555a-2c3a-4bad-be9a-d313252129f8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:18.255219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b099555a-2c3a-4bad-be9a-d313252129f8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:18.255703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b099555a-2c3a-4bad-be9a-d313252129f8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:18.256484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b099555a-2c3a-4bad-be9a-d313252129f8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:18.256911 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b099555a-2c3a-4bad-be9a-d313252129f8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:18.391333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b099555a-2c3a-4bad-be9a-d313252129f8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:18.402633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b099555a-2c3a-4bad-be9a-d313252129f8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158947 Jul 04 06:12:18.403316 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 779/1561] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:18 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:19.424246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f9d14a35-d4d9-4da6-abd0-c45dad3c7d3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:19.425284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f9d14a35-d4d9-4da6-abd0-c45dad3c7d3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:19.435232 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d14a35-d4d9-4da6-abd0-c45dad3c7d3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:19.435812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d14a35-d4d9-4da6-abd0-c45dad3c7d3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:19.436480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d14a35-d4d9-4da6-abd0-c45dad3c7d3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:19.436903 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d14a35-d4d9-4da6-abd0-c45dad3c7d3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:19.569341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f9d14a35-d4d9-4da6-abd0-c45dad3c7d3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:19.577924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f9d14a35-d4d9-4da6-abd0-c45dad3c7d3f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.160087 Jul 04 06:12:19.578498 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 783/1562] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:19 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:20.596532 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9b312f93-0308-4917-b2c3-0856b133383c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:20.598952 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9b312f93-0308-4917-b2c3-0856b133383c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:20.615825 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b312f93-0308-4917-b2c3-0856b133383c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:20.616282 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b312f93-0308-4917-b2c3-0856b133383c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:20.617051 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b312f93-0308-4917-b2c3-0856b133383c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:20.617495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b312f93-0308-4917-b2c3-0856b133383c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:20.707453 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-042b228e-76dc-4a58-a997-67ede7c30bb6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:20.708631 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-042b228e-76dc-4a58-a997-67ede7c30bb6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:20.717542 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-042b228e-76dc-4a58-a997-67ede7c30bb6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:20.718500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-042b228e-76dc-4a58-a997-67ede7c30bb6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:20.719524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-042b228e-76dc-4a58-a997-67ede7c30bb6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:20.720157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-042b228e-76dc-4a58-a997-67ede7c30bb6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:20.757766 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-042b228e-76dc-4a58-a997-67ede7c30bb6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:12:20.799866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9b312f93-0308-4917-b2c3-0856b133383c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:20.808537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9b312f93-0308-4917-b2c3-0856b133383c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.218472 Jul 04 06:12:20.809104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 780/1563] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:20 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:20.839662 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-042b228e-76dc-4a58-a997-67ede7c30bb6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 204 len: 0 microversion: 2.1 time: 0.135765 Jul 04 06:12:20.840291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 784/1564] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:12:20 2022] DELETE /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 06:12:20.848776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8e071fc4-3523-4fb2-883f-3146e4aa51b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:20.849371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8e071fc4-3523-4fb2-883f-3146e4aa51b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:20.855580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e071fc4-3523-4fb2-883f-3146e4aa51b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:20.856023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e071fc4-3523-4fb2-883f-3146e4aa51b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:20.856774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e071fc4-3523-4fb2-883f-3146e4aa51b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:20.857212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e071fc4-3523-4fb2-883f-3146e4aa51b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:20.999860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8e071fc4-3523-4fb2-883f-3146e4aa51b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:21.011124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8e071fc4-3523-4fb2-883f-3146e4aa51b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1734 microversion: 2.1 time: 0.165836 Jul 04 06:12:21.011974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 781/1565] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:20 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:21.826939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f935913d-54b5-42b8-a608-e1a2833ca541 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:21.827758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f935913d-54b5-42b8-a608-e1a2833ca541 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:21.834348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f935913d-54b5-42b8-a608-e1a2833ca541 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:21.834791 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f935913d-54b5-42b8-a608-e1a2833ca541 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:21.835588 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f935913d-54b5-42b8-a608-e1a2833ca541 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:21.836012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f935913d-54b5-42b8-a608-e1a2833ca541 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:22.034593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-24b283a2-4811-42f3-8ca6-0ac68c273d71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:22.035221 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-24b283a2-4811-42f3-8ca6-0ac68c273d71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:22.042139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24b283a2-4811-42f3-8ca6-0ac68c273d71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:22.042645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24b283a2-4811-42f3-8ca6-0ac68c273d71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:22.043484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24b283a2-4811-42f3-8ca6-0ac68c273d71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:22.043919 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24b283a2-4811-42f3-8ca6-0ac68c273d71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:22.071225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f935913d-54b5-42b8-a608-e1a2833ca541 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:22.080074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f935913d-54b5-42b8-a608-e1a2833ca541 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.257835 Jul 04 06:12:22.080653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 785/1566] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:21 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:22.109559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-24b283a2-4811-42f3-8ca6-0ac68c273d71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:22.117423 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-24b283a2-4811-42f3-8ca6-0ac68c273d71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1667 microversion: 2.1 time: 0.086938 Jul 04 06:12:22.117999 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 782/1567] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1667 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:22.259296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-d7dc5a88-734c-4f93-8678-f3188a1ad20a req-64146696-45d7-4bc6-8fb5-4ab26bc6aab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6141b5a5-5e40-4d2e-afb1-ff85c45f0620", "name": "network-vif-deleted", "tag": "1015e693-9c03-489d-bc15-506c5f4f1b3b"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:12:22.268925 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d7dc5a88-734c-4f93-8678-f3188a1ad20a req-64146696-45d7-4bc6-8fb5-4ab26bc6aab0 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:22.269653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d7dc5a88-734c-4f93-8678-f3188a1ad20a req-64146696-45d7-4bc6-8fb5-4ab26bc6aab0 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:22.282140 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-d7dc5a88-734c-4f93-8678-f3188a1ad20a req-64146696-45d7-4bc6-8fb5-4ab26bc6aab0 service nova] Creating event network-vif-deleted:1015e693-9c03-489d-bc15-506c5f4f1b3b for instance 6141b5a5-5e40-4d2e-afb1-ff85c45f0620 on hv-cinder-79733 Jul 04 06:12:22.287896 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-d7dc5a88-734c-4f93-8678-f3188a1ad20a req-64146696-45d7-4bc6-8fb5-4ab26bc6aab0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032033 Jul 04 06:12:22.289298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 786/1568] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:12:23.097730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73afe1f7-fc5a-4df0-ab90-9f0b0a7d63ea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:23.098352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73afe1f7-fc5a-4df0-ab90-9f0b0a7d63ea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:23.104988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73afe1f7-fc5a-4df0-ab90-9f0b0a7d63ea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:23.105702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73afe1f7-fc5a-4df0-ab90-9f0b0a7d63ea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:23.106477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73afe1f7-fc5a-4df0-ab90-9f0b0a7d63ea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:23.106876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73afe1f7-fc5a-4df0-ab90-9f0b0a7d63ea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:23.135142 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0f8ca4f-373b-4093-aa3d-063c02e695a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:23.136092 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c0f8ca4f-373b-4093-aa3d-063c02e695a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:23.142902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f8ca4f-373b-4093-aa3d-063c02e695a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:23.143512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f8ca4f-373b-4093-aa3d-063c02e695a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:23.144356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f8ca4f-373b-4093-aa3d-063c02e695a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:23.144850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f8ca4f-373b-4093-aa3d-063c02e695a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:23.218282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c0f8ca4f-373b-4093-aa3d-063c02e695a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:23.226953 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c0f8ca4f-373b-4093-aa3d-063c02e695a0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096579 Jul 04 06:12:23.227642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 787/1569] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:23.255888 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73afe1f7-fc5a-4df0-ab90-9f0b0a7d63ea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:23.264367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73afe1f7-fc5a-4df0-ab90-9f0b0a7d63ea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170744 Jul 04 06:12:23.264941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 783/1570] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:23 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:24.247772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-595077cc-2795-4a90-bc20-1c5651ccc477 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:24.248810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-595077cc-2795-4a90-bc20-1c5651ccc477 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:24.260106 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-595077cc-2795-4a90-bc20-1c5651ccc477 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:24.260853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-595077cc-2795-4a90-bc20-1c5651ccc477 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:24.262045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-595077cc-2795-4a90-bc20-1c5651ccc477 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:24.262465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-595077cc-2795-4a90-bc20-1c5651ccc477 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:24.282065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2c8546ed-fc7d-4f7d-b0f8-6becb9188fc1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:24.282675 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2c8546ed-fc7d-4f7d-b0f8-6becb9188fc1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:24.289562 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8546ed-fc7d-4f7d-b0f8-6becb9188fc1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:24.290014 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8546ed-fc7d-4f7d-b0f8-6becb9188fc1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:24.290790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8546ed-fc7d-4f7d-b0f8-6becb9188fc1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:24.291231 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c8546ed-fc7d-4f7d-b0f8-6becb9188fc1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:24.325189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-595077cc-2795-4a90-bc20-1c5651ccc477 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:24.333507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-595077cc-2795-4a90-bc20-1c5651ccc477 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092195 Jul 04 06:12:24.334059 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 788/1571] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:24.423565 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2c8546ed-fc7d-4f7d-b0f8-6becb9188fc1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:24.431815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2c8546ed-fc7d-4f7d-b0f8-6becb9188fc1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.153969 Jul 04 06:12:24.432371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 784/1572] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:24 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:25.350157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e278dca4-8725-4d1f-b6a1-41a9490b256a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:25.350750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e278dca4-8725-4d1f-b6a1-41a9490b256a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:25.357614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e278dca4-8725-4d1f-b6a1-41a9490b256a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:25.358080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e278dca4-8725-4d1f-b6a1-41a9490b256a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:25.358839 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e278dca4-8725-4d1f-b6a1-41a9490b256a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:25.359293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e278dca4-8725-4d1f-b6a1-41a9490b256a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:25.431853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e278dca4-8725-4d1f-b6a1-41a9490b256a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:25.441074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e278dca4-8725-4d1f-b6a1-41a9490b256a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094834 Jul 04 06:12:25.441641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 789/1573] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:25.449286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-070f1581-5401-4b62-b85c-8c5b27b6c3db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:25.449897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-070f1581-5401-4b62-b85c-8c5b27b6c3db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:25.456810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-070f1581-5401-4b62-b85c-8c5b27b6c3db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:25.457257 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-070f1581-5401-4b62-b85c-8c5b27b6c3db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:25.458018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-070f1581-5401-4b62-b85c-8c5b27b6c3db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:25.458448 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-070f1581-5401-4b62-b85c-8c5b27b6c3db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:25.588692 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-070f1581-5401-4b62-b85c-8c5b27b6c3db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:25.596689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-070f1581-5401-4b62-b85c-8c5b27b6c3db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.151242 Jul 04 06:12:25.597253 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 785/1574] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:25 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:26.460673 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-998364fc-5806-4b9d-9565-f7012a2cd9a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:26.461373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-998364fc-5806-4b9d-9565-f7012a2cd9a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:26.473781 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-998364fc-5806-4b9d-9565-f7012a2cd9a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:26.474414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-998364fc-5806-4b9d-9565-f7012a2cd9a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:26.475503 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-998364fc-5806-4b9d-9565-f7012a2cd9a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:26.476110 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-998364fc-5806-4b9d-9565-f7012a2cd9a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:26.547533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-998364fc-5806-4b9d-9565-f7012a2cd9a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:26.555847 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-998364fc-5806-4b9d-9565-f7012a2cd9a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.101039 Jul 04 06:12:26.556453 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 790/1575] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:26.618057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8bc9a684-d042-4d38-bbf3-448908d67176 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:26.619081 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8bc9a684-d042-4d38-bbf3-448908d67176 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:26.630168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bc9a684-d042-4d38-bbf3-448908d67176 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:26.630916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bc9a684-d042-4d38-bbf3-448908d67176 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:26.632232 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bc9a684-d042-4d38-bbf3-448908d67176 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:26.632957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bc9a684-d042-4d38-bbf3-448908d67176 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:26.769958 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8bc9a684-d042-4d38-bbf3-448908d67176 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:26.778339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8bc9a684-d042-4d38-bbf3-448908d67176 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.166750 Jul 04 06:12:26.778910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 786/1576] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:26 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:27.572719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-db28deca-2039-4275-ab33-9f3db97496b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:27.573349 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-db28deca-2039-4275-ab33-9f3db97496b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:27.580468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db28deca-2039-4275-ab33-9f3db97496b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:27.580919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db28deca-2039-4275-ab33-9f3db97496b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:27.581681 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db28deca-2039-4275-ab33-9f3db97496b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:27.582117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db28deca-2039-4275-ab33-9f3db97496b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:27.646091 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-db28deca-2039-4275-ab33-9f3db97496b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:27.654846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-db28deca-2039-4275-ab33-9f3db97496b5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085761 Jul 04 06:12:27.655467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 791/1577] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:27.800538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-94f1da4e-1e0d-4c9b-a808-e6b5ba4a1aff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:27.801536 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-94f1da4e-1e0d-4c9b-a808-e6b5ba4a1aff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:27.811189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94f1da4e-1e0d-4c9b-a808-e6b5ba4a1aff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:27.811661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94f1da4e-1e0d-4c9b-a808-e6b5ba4a1aff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:27.812422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94f1da4e-1e0d-4c9b-a808-e6b5ba4a1aff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:27.812854 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94f1da4e-1e0d-4c9b-a808-e6b5ba4a1aff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:27.951023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-94f1da4e-1e0d-4c9b-a808-e6b5ba4a1aff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:27.953328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:12:27.960326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-94f1da4e-1e0d-4c9b-a808-e6b5ba4a1aff tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.166570 Jul 04 06:12:27.960894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 787/1578] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:27 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:28.674310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-43ef49ed-f38d-4f75-a0c3-8713395e89bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:28.675000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-43ef49ed-f38d-4f75-a0c3-8713395e89bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:28.682989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43ef49ed-f38d-4f75-a0c3-8713395e89bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:28.683606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43ef49ed-f38d-4f75-a0c3-8713395e89bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:28.684513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43ef49ed-f38d-4f75-a0c3-8713395e89bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:28.685023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43ef49ed-f38d-4f75-a0c3-8713395e89bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:28.748320 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-43ef49ed-f38d-4f75-a0c3-8713395e89bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:28.750675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:12:28.757684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-43ef49ed-f38d-4f75-a0c3-8713395e89bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088251 Jul 04 06:12:28.758186 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 792/1579] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:28.982339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92fb88dc-63ec-4533-a499-a89d83ef0c2e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:28.983109 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92fb88dc-63ec-4533-a499-a89d83ef0c2e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:28.991084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92fb88dc-63ec-4533-a499-a89d83ef0c2e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:28.991661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92fb88dc-63ec-4533-a499-a89d83ef0c2e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:28.992562 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92fb88dc-63ec-4533-a499-a89d83ef0c2e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:28.993075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92fb88dc-63ec-4533-a499-a89d83ef0c2e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:29.139398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-92fb88dc-63ec-4533-a499-a89d83ef0c2e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:29.147535 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92fb88dc-63ec-4533-a499-a89d83ef0c2e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.172099 Jul 04 06:12:29.148101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 788/1580] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:28 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:29.779665 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a5e6b305-42a1-4f49-8d41-e91e33361835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:29.780287 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a5e6b305-42a1-4f49-8d41-e91e33361835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:29.788058 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5e6b305-42a1-4f49-8d41-e91e33361835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:29.788535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5e6b305-42a1-4f49-8d41-e91e33361835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:29.789303 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5e6b305-42a1-4f49-8d41-e91e33361835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:29.789734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5e6b305-42a1-4f49-8d41-e91e33361835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:29.854527 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a5e6b305-42a1-4f49-8d41-e91e33361835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:29.863309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a5e6b305-42a1-4f49-8d41-e91e33361835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091095 Jul 04 06:12:29.863882 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 793/1581] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:30.169077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f6e36722-5fc6-4bd0-a225-d94acf369d43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:30.169840 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f6e36722-5fc6-4bd0-a225-d94acf369d43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:30.176844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6e36722-5fc6-4bd0-a225-d94acf369d43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:30.177295 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6e36722-5fc6-4bd0-a225-d94acf369d43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:30.178055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6e36722-5fc6-4bd0-a225-d94acf369d43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:30.178487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6e36722-5fc6-4bd0-a225-d94acf369d43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:30.311112 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f6e36722-5fc6-4bd0-a225-d94acf369d43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:30.319488 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f6e36722-5fc6-4bd0-a225-d94acf369d43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156970 Jul 04 06:12:30.320055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 789/1582] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:30 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:30.884632 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a6525de9-5573-40a0-9e47-8975f22d19fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:30.885552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a6525de9-5573-40a0-9e47-8975f22d19fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:30.896464 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6525de9-5573-40a0-9e47-8975f22d19fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:30.897214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6525de9-5573-40a0-9e47-8975f22d19fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:30.898459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6525de9-5573-40a0-9e47-8975f22d19fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:30.899195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6525de9-5573-40a0-9e47-8975f22d19fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:30.969604 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a6525de9-5573-40a0-9e47-8975f22d19fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:30.977810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a6525de9-5573-40a0-9e47-8975f22d19fd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.099841 Jul 04 06:12:30.978369 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 794/1583] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:30 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:31.340969 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-df00b2cd-a645-4ecd-80fb-9fa03e3b95c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:31.341997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-df00b2cd-a645-4ecd-80fb-9fa03e3b95c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:31.350692 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df00b2cd-a645-4ecd-80fb-9fa03e3b95c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:31.351290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df00b2cd-a645-4ecd-80fb-9fa03e3b95c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:31.352253 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df00b2cd-a645-4ecd-80fb-9fa03e3b95c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:31.352801 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df00b2cd-a645-4ecd-80fb-9fa03e3b95c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:31.491658 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df00b2cd-a645-4ecd-80fb-9fa03e3b95c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:31.500351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-df00b2cd-a645-4ecd-80fb-9fa03e3b95c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165858 Jul 04 06:12:31.500890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 790/1584] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:31 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:31.833401 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:12:31.833773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:12:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:12:31.997860 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5456c29b-6a05-4394-8777-f5c240047fb8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:31.998926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5456c29b-6a05-4394-8777-f5c240047fb8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:32.009943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5456c29b-6a05-4394-8777-f5c240047fb8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:32.010685 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5456c29b-6a05-4394-8777-f5c240047fb8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:32.012022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5456c29b-6a05-4394-8777-f5c240047fb8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:32.012745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5456c29b-6a05-4394-8777-f5c240047fb8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:32.085998 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5456c29b-6a05-4394-8777-f5c240047fb8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:32.094468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5456c29b-6a05-4394-8777-f5c240047fb8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.103081 Jul 04 06:12:32.095038 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 795/1585] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:31 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:32.520444 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cc5bde0c-37e9-4f52-ac1c-ec39395ba08a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:32.521056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cc5bde0c-37e9-4f52-ac1c-ec39395ba08a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:32.523473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=42 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:12:32.528870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc5bde0c-37e9-4f52-ac1c-ec39395ba08a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:32.529683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc5bde0c-37e9-4f52-ac1c-ec39395ba08a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:32.530456 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc5bde0c-37e9-4f52-ac1c-ec39395ba08a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:32.530920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc5bde0c-37e9-4f52-ac1c-ec39395ba08a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:32.668809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cc5bde0c-37e9-4f52-ac1c-ec39395ba08a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:32.677043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cc5bde0c-37e9-4f52-ac1c-ec39395ba08a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162304 Jul 04 06:12:32.677614 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 791/1586] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:32 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:33.110946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a29bf0bc-2185-4b83-9dc8-d4e669996073 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:33.111716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a29bf0bc-2185-4b83-9dc8-d4e669996073 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:33.118804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a29bf0bc-2185-4b83-9dc8-d4e669996073 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:33.119188 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a29bf0bc-2185-4b83-9dc8-d4e669996073 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:33.119981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a29bf0bc-2185-4b83-9dc8-d4e669996073 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:33.120415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a29bf0bc-2185-4b83-9dc8-d4e669996073 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:33.195541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a29bf0bc-2185-4b83-9dc8-d4e669996073 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:33.203929 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a29bf0bc-2185-4b83-9dc8-d4e669996073 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096823 Jul 04 06:12:33.204507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 796/1587] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:33.697402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-260fcc06-5f4c-4ce3-9eff-7a5b5095ec5f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:33.698309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-260fcc06-5f4c-4ce3-9eff-7a5b5095ec5f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:33.708819 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-260fcc06-5f4c-4ce3-9eff-7a5b5095ec5f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:33.709507 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-260fcc06-5f4c-4ce3-9eff-7a5b5095ec5f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:33.710756 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-260fcc06-5f4c-4ce3-9eff-7a5b5095ec5f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:33.711472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-260fcc06-5f4c-4ce3-9eff-7a5b5095ec5f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:33.847829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-260fcc06-5f4c-4ce3-9eff-7a5b5095ec5f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:33.856462 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-260fcc06-5f4c-4ce3-9eff-7a5b5095ec5f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165066 Jul 04 06:12:33.857070 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 792/1588] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:33 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:34.209829 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:12:34.210768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:12:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:12:34.226477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1414879b-1714-4f19-9337-68d79a7f1318 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:34.227534 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1414879b-1714-4f19-9337-68d79a7f1318 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:34.236026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1414879b-1714-4f19-9337-68d79a7f1318 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:34.236483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1414879b-1714-4f19-9337-68d79a7f1318 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:34.237244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1414879b-1714-4f19-9337-68d79a7f1318 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:34.237686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1414879b-1714-4f19-9337-68d79a7f1318 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:34.302809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1414879b-1714-4f19-9337-68d79a7f1318 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:34.313824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1414879b-1714-4f19-9337-68d79a7f1318 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094167 Jul 04 06:12:34.314398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 797/1589] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:34.878207 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fa190fb6-b266-40fd-800a-7eb000894173 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:34.879117 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fa190fb6-b266-40fd-800a-7eb000894173 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:34.889757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa190fb6-b266-40fd-800a-7eb000894173 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:34.890351 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa190fb6-b266-40fd-800a-7eb000894173 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:34.891137 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa190fb6-b266-40fd-800a-7eb000894173 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:34.891610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa190fb6-b266-40fd-800a-7eb000894173 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:35.028094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fa190fb6-b266-40fd-800a-7eb000894173 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:35.037138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fa190fb6-b266-40fd-800a-7eb000894173 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165812 Jul 04 06:12:35.037689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 793/1590] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:34 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:35.334007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-18cfb9a1-34c2-432c-b28d-1113f56af4bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:35.334958 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-18cfb9a1-34c2-432c-b28d-1113f56af4bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:35.338661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:12:35.345802 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18cfb9a1-34c2-432c-b28d-1113f56af4bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:35.346251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18cfb9a1-34c2-432c-b28d-1113f56af4bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:35.347018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18cfb9a1-34c2-432c-b28d-1113f56af4bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:35.347486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18cfb9a1-34c2-432c-b28d-1113f56af4bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:35.410321 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-18cfb9a1-34c2-432c-b28d-1113f56af4bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:35.418693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-18cfb9a1-34c2-432c-b28d-1113f56af4bd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091145 Jul 04 06:12:35.419274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 798/1591] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:36.058488 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0cf08b2a-c4af-4efc-8eba-342f9d91fcec tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:36.059533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0cf08b2a-c4af-4efc-8eba-342f9d91fcec tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:36.067584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf08b2a-c4af-4efc-8eba-342f9d91fcec tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:36.068181 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf08b2a-c4af-4efc-8eba-342f9d91fcec tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:36.069039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf08b2a-c4af-4efc-8eba-342f9d91fcec tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:36.069574 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cf08b2a-c4af-4efc-8eba-342f9d91fcec tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:36.205730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0cf08b2a-c4af-4efc-8eba-342f9d91fcec tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:36.219496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0cf08b2a-c4af-4efc-8eba-342f9d91fcec tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167099 Jul 04 06:12:36.220409 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 794/1592] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:36 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:36.439771 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-697a9620-e035-4354-90c0-c2b461ec9d01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:36.440704 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-697a9620-e035-4354-90c0-c2b461ec9d01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:36.451568 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-697a9620-e035-4354-90c0-c2b461ec9d01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:36.452021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-697a9620-e035-4354-90c0-c2b461ec9d01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:36.452785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-697a9620-e035-4354-90c0-c2b461ec9d01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:36.453221 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-697a9620-e035-4354-90c0-c2b461ec9d01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:36.522682 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-697a9620-e035-4354-90c0-c2b461ec9d01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:36.531562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-697a9620-e035-4354-90c0-c2b461ec9d01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098493 Jul 04 06:12:36.532120 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 799/1593] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:37.245342 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-951c7a34-2baf-48c2-a589-454aad6dfe6c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:37.246232 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-951c7a34-2baf-48c2-a589-454aad6dfe6c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:37.256315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-951c7a34-2baf-48c2-a589-454aad6dfe6c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:37.257002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-951c7a34-2baf-48c2-a589-454aad6dfe6c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:37.258155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-951c7a34-2baf-48c2-a589-454aad6dfe6c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:37.258866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-951c7a34-2baf-48c2-a589-454aad6dfe6c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:37.402565 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-951c7a34-2baf-48c2-a589-454aad6dfe6c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:37.411162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-951c7a34-2baf-48c2-a589-454aad6dfe6c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.171878 Jul 04 06:12:37.411782 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 795/1594] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:37 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:37.549169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f8b8410e-8b90-4776-aee3-da4556ca2433 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:37.549794 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f8b8410e-8b90-4776-aee3-da4556ca2433 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:37.556796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8b8410e-8b90-4776-aee3-da4556ca2433 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:37.557243 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8b8410e-8b90-4776-aee3-da4556ca2433 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:37.557996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8b8410e-8b90-4776-aee3-da4556ca2433 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:37.558424 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8b8410e-8b90-4776-aee3-da4556ca2433 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:37.621223 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f8b8410e-8b90-4776-aee3-da4556ca2433 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:37.629416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f8b8410e-8b90-4776-aee3-da4556ca2433 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.084189 Jul 04 06:12:37.629990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 800/1595] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:38.432633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b10abf6-272d-4fb8-a183-9c597fec25f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:38.433620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2b10abf6-272d-4fb8-a183-9c597fec25f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:38.445490 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b10abf6-272d-4fb8-a183-9c597fec25f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:38.446245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b10abf6-272d-4fb8-a183-9c597fec25f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:38.447580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b10abf6-272d-4fb8-a183-9c597fec25f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:38.448300 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b10abf6-272d-4fb8-a183-9c597fec25f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:38.583161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2b10abf6-272d-4fb8-a183-9c597fec25f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:38.595365 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2b10abf6-272d-4fb8-a183-9c597fec25f1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168917 Jul 04 06:12:38.596094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 796/1596] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:38 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:38.649513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-35a01b11-9fc9-4472-8768-7cf24cec8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:38.650446 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-35a01b11-9fc9-4472-8768-7cf24cec8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:38.662233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35a01b11-9fc9-4472-8768-7cf24cec8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:38.662950 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35a01b11-9fc9-4472-8768-7cf24cec8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:38.664264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35a01b11-9fc9-4472-8768-7cf24cec8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:38.664972 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35a01b11-9fc9-4472-8768-7cf24cec8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:38.728288 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-35a01b11-9fc9-4472-8768-7cf24cec8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:38.736716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-35a01b11-9fc9-4472-8768-7cf24cec8347 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093792 Jul 04 06:12:38.737272 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 801/1597] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:39.617328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d349476d-339a-41a5-af44-562426d41109 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:39.618387 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d349476d-339a-41a5-af44-562426d41109 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:39.629078 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d349476d-339a-41a5-af44-562426d41109 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:39.629736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d349476d-339a-41a5-af44-562426d41109 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:39.630910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d349476d-339a-41a5-af44-562426d41109 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:39.631464 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d349476d-339a-41a5-af44-562426d41109 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:39.753513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ce49c912-ea25-4487-ab1f-2e9eb7040266 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:39.754103 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ce49c912-ea25-4487-ab1f-2e9eb7040266 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:39.760871 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce49c912-ea25-4487-ab1f-2e9eb7040266 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:39.761321 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce49c912-ea25-4487-ab1f-2e9eb7040266 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:39.762085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce49c912-ea25-4487-ab1f-2e9eb7040266 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:39.762517 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce49c912-ea25-4487-ab1f-2e9eb7040266 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:39.771466 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d349476d-339a-41a5-af44-562426d41109 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:39.779837 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d349476d-339a-41a5-af44-562426d41109 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169097 Jul 04 06:12:39.780576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 797/1598] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:39 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:39.823430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ce49c912-ea25-4487-ab1f-2e9eb7040266 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:39.831518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ce49c912-ea25-4487-ab1f-2e9eb7040266 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.081867 Jul 04 06:12:39.832081 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 802/1599] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:40.801638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9db13bff-7d93-4fff-a50b-461770fc5d42 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:40.802587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9db13bff-7d93-4fff-a50b-461770fc5d42 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:40.813454 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9db13bff-7d93-4fff-a50b-461770fc5d42 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:40.814200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9db13bff-7d93-4fff-a50b-461770fc5d42 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:40.815509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9db13bff-7d93-4fff-a50b-461770fc5d42 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:40.816235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9db13bff-7d93-4fff-a50b-461770fc5d42 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:40.847691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9011f171-9122-41ce-9559-03c986af5d28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:40.848265 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9011f171-9122-41ce-9559-03c986af5d28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:40.855263 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9011f171-9122-41ce-9559-03c986af5d28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:40.855727 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9011f171-9122-41ce-9559-03c986af5d28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:40.856510 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9011f171-9122-41ce-9559-03c986af5d28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:40.856935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9011f171-9122-41ce-9559-03c986af5d28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:40.923122 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9011f171-9122-41ce-9559-03c986af5d28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:40.931484 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9011f171-9122-41ce-9559-03c986af5d28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087580 Jul 04 06:12:40.932048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 803/1600] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:40.955785 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9db13bff-7d93-4fff-a50b-461770fc5d42 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:40.965190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9db13bff-7d93-4fff-a50b-461770fc5d42 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170382 Jul 04 06:12:40.965759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 798/1601] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:40 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:41.951136 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9685f55b-bf9c-4f4f-a75f-4ed38cab5b4b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:41.952095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9685f55b-bf9c-4f4f-a75f-4ed38cab5b4b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:41.961774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9685f55b-bf9c-4f4f-a75f-4ed38cab5b4b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:41.962404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9685f55b-bf9c-4f4f-a75f-4ed38cab5b4b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:41.963523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9685f55b-bf9c-4f4f-a75f-4ed38cab5b4b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:41.964094 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9685f55b-bf9c-4f4f-a75f-4ed38cab5b4b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:41.982418 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca7eb66c-dcd9-4b27-ac69-4f47c0a22942 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:41.983003 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca7eb66c-dcd9-4b27-ac69-4f47c0a22942 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:41.990182 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca7eb66c-dcd9-4b27-ac69-4f47c0a22942 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:41.990636 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca7eb66c-dcd9-4b27-ac69-4f47c0a22942 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:41.991445 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca7eb66c-dcd9-4b27-ac69-4f47c0a22942 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:41.991999 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca7eb66c-dcd9-4b27-ac69-4f47c0a22942 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:42.026824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9685f55b-bf9c-4f4f-a75f-4ed38cab5b4b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:42.035623 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9685f55b-bf9c-4f4f-a75f-4ed38cab5b4b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090103 Jul 04 06:12:42.036211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 804/1602] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:41 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:42.121009 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca7eb66c-dcd9-4b27-ac69-4f47c0a22942 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:42.129710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca7eb66c-dcd9-4b27-ac69-4f47c0a22942 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.151511 Jul 04 06:12:42.130332 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 799/1603] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:41 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:43.052579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-96ad67d2-3e2a-4d56-9536-33ba8bf66e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:43.053179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-96ad67d2-3e2a-4d56-9536-33ba8bf66e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:43.060422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96ad67d2-3e2a-4d56-9536-33ba8bf66e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:43.060874 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96ad67d2-3e2a-4d56-9536-33ba8bf66e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:43.061637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96ad67d2-3e2a-4d56-9536-33ba8bf66e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:43.062074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96ad67d2-3e2a-4d56-9536-33ba8bf66e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:43.133310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-96ad67d2-3e2a-4d56-9536-33ba8bf66e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:43.143573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-96ad67d2-3e2a-4d56-9536-33ba8bf66e03 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094876 Jul 04 06:12:43.144139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 805/1604] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:43.147283 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-10ad32c9-1866-435e-8cf6-be7cde34d8de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:43.147918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-10ad32c9-1866-435e-8cf6-be7cde34d8de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:43.155165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10ad32c9-1866-435e-8cf6-be7cde34d8de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:43.155657 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10ad32c9-1866-435e-8cf6-be7cde34d8de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:43.156436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10ad32c9-1866-435e-8cf6-be7cde34d8de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:43.156868 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10ad32c9-1866-435e-8cf6-be7cde34d8de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:43.544202 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-10ad32c9-1866-435e-8cf6-be7cde34d8de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:43.555809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-10ad32c9-1866-435e-8cf6-be7cde34d8de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.412424 Jul 04 06:12:43.556381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 800/1605] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:43 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:44.164765 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4d633a10-e2a2-469b-bcd6-c25810e12a94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:44.165711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4d633a10-e2a2-469b-bcd6-c25810e12a94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:44.176959 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d633a10-e2a2-469b-bcd6-c25810e12a94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:44.177694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d633a10-e2a2-469b-bcd6-c25810e12a94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:44.178933 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d633a10-e2a2-469b-bcd6-c25810e12a94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:44.179688 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d633a10-e2a2-469b-bcd6-c25810e12a94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:44.252409 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4d633a10-e2a2-469b-bcd6-c25810e12a94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:44.260905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4d633a10-e2a2-469b-bcd6-c25810e12a94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.102542 Jul 04 06:12:44.261475 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 806/1606] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:44 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:44.573579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-41990825-4ef3-43bc-be02-7463a02cc8da tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:44.574163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-41990825-4ef3-43bc-be02-7463a02cc8da tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:44.581244 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41990825-4ef3-43bc-be02-7463a02cc8da tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:44.581699 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41990825-4ef3-43bc-be02-7463a02cc8da tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:44.582451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41990825-4ef3-43bc-be02-7463a02cc8da tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:44.582884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41990825-4ef3-43bc-be02-7463a02cc8da tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:44.717524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-41990825-4ef3-43bc-be02-7463a02cc8da tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:44.728404 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-41990825-4ef3-43bc-be02-7463a02cc8da tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158492 Jul 04 06:12:44.729216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 801/1607] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:44 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:45.281876 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-017a8b93-613f-404b-a5f5-7a1f327b9898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:45.282859 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-017a8b93-613f-404b-a5f5-7a1f327b9898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:45.293743 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-017a8b93-613f-404b-a5f5-7a1f327b9898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:45.294620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-017a8b93-613f-404b-a5f5-7a1f327b9898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:45.295444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-017a8b93-613f-404b-a5f5-7a1f327b9898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:45.295877 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-017a8b93-613f-404b-a5f5-7a1f327b9898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:45.360143 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-017a8b93-613f-404b-a5f5-7a1f327b9898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:45.368715 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-017a8b93-613f-404b-a5f5-7a1f327b9898 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093612 Jul 04 06:12:45.369315 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 807/1608] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:45.751220 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-de80a4e1-34e2-4bb2-a34a-44140448f8a1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:45.752238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-de80a4e1-34e2-4bb2-a34a-44140448f8a1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:45.763301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de80a4e1-34e2-4bb2-a34a-44140448f8a1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:45.764079 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de80a4e1-34e2-4bb2-a34a-44140448f8a1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:45.765348 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de80a4e1-34e2-4bb2-a34a-44140448f8a1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:45.766075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de80a4e1-34e2-4bb2-a34a-44140448f8a1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:45.906745 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-de80a4e1-34e2-4bb2-a34a-44140448f8a1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:45.915422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-de80a4e1-34e2-4bb2-a34a-44140448f8a1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170802 Jul 04 06:12:45.916001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 802/1609] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:45 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:46.389716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1edb7d48-1b19-4eb5-a947-81ef3806fc33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:46.390724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1edb7d48-1b19-4eb5-a947-81ef3806fc33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:46.401957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1edb7d48-1b19-4eb5-a947-81ef3806fc33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:46.402702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1edb7d48-1b19-4eb5-a947-81ef3806fc33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:46.404414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1edb7d48-1b19-4eb5-a947-81ef3806fc33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:46.404853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1edb7d48-1b19-4eb5-a947-81ef3806fc33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:46.476369 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1edb7d48-1b19-4eb5-a947-81ef3806fc33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:46.484869 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1edb7d48-1b19-4eb5-a947-81ef3806fc33 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.101631 Jul 04 06:12:46.485433 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 808/1610] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:46 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:46.936970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7af01db9-be8d-4024-bc3a-112c247c3690 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:46.937848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7af01db9-be8d-4024-bc3a-112c247c3690 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:46.949013 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7af01db9-be8d-4024-bc3a-112c247c3690 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:46.949791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7af01db9-be8d-4024-bc3a-112c247c3690 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:46.951104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7af01db9-be8d-4024-bc3a-112c247c3690 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:46.951567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7af01db9-be8d-4024-bc3a-112c247c3690 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:47.092420 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7af01db9-be8d-4024-bc3a-112c247c3690 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:47.100479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7af01db9-be8d-4024-bc3a-112c247c3690 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170086 Jul 04 06:12:47.101044 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 803/1611] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:46 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:47.509721 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-49df1294-cf83-4dc6-a7f3-f8c992c408b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:47.510712 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-49df1294-cf83-4dc6-a7f3-f8c992c408b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:47.519023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49df1294-cf83-4dc6-a7f3-f8c992c408b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:47.519146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49df1294-cf83-4dc6-a7f3-f8c992c408b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:47.519941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49df1294-cf83-4dc6-a7f3-f8c992c408b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:47.520374 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49df1294-cf83-4dc6-a7f3-f8c992c408b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:47.536177 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:12:47.583850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-49df1294-cf83-4dc6-a7f3-f8c992c408b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:47.592045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-49df1294-cf83-4dc6-a7f3-f8c992c408b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088892 Jul 04 06:12:47.592616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 809/1612] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:48.122175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-831040ba-e3a2-4514-8d0a-ce9cb6aa257e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:48.123108 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-831040ba-e3a2-4514-8d0a-ce9cb6aa257e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:48.130852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-831040ba-e3a2-4514-8d0a-ce9cb6aa257e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:48.131397 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-831040ba-e3a2-4514-8d0a-ce9cb6aa257e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:48.132248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-831040ba-e3a2-4514-8d0a-ce9cb6aa257e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:48.132733 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-831040ba-e3a2-4514-8d0a-ce9cb6aa257e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:48.153509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:12:48.273130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-831040ba-e3a2-4514-8d0a-ce9cb6aa257e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:48.285177 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-831040ba-e3a2-4514-8d0a-ce9cb6aa257e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169395 Jul 04 06:12:48.285945 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 804/1613] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:48 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:48.613118 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4b01326a-7695-474b-bea9-4316bb5e98e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:48.614066 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4b01326a-7695-474b-bea9-4316bb5e98e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:48.624226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b01326a-7695-474b-bea9-4316bb5e98e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:48.624665 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b01326a-7695-474b-bea9-4316bb5e98e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:48.625416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b01326a-7695-474b-bea9-4316bb5e98e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:48.625840 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b01326a-7695-474b-bea9-4316bb5e98e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:48.694127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4b01326a-7695-474b-bea9-4316bb5e98e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:48.702466 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4b01326a-7695-474b-bea9-4316bb5e98e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096122 Jul 04 06:12:48.703048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 810/1614] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:49.303040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-764d51c5-ac8b-46ee-8ccb-250a6a0db763 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:49.303771 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-764d51c5-ac8b-46ee-8ccb-250a6a0db763 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:49.310740 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-764d51c5-ac8b-46ee-8ccb-250a6a0db763 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:49.311168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-764d51c5-ac8b-46ee-8ccb-250a6a0db763 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:49.311959 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-764d51c5-ac8b-46ee-8ccb-250a6a0db763 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:49.312390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-764d51c5-ac8b-46ee-8ccb-250a6a0db763 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:49.457629 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-764d51c5-ac8b-46ee-8ccb-250a6a0db763 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:49.469191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-764d51c5-ac8b-46ee-8ccb-250a6a0db763 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169974 Jul 04 06:12:49.469776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 805/1615] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:49 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:49.723367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e37d89e3-eadf-4842-87ba-35c8d06b2951 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:49.724251 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e37d89e3-eadf-4842-87ba-35c8d06b2951 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:49.734119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e37d89e3-eadf-4842-87ba-35c8d06b2951 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:49.734570 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e37d89e3-eadf-4842-87ba-35c8d06b2951 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:49.735374 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e37d89e3-eadf-4842-87ba-35c8d06b2951 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:49.735810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e37d89e3-eadf-4842-87ba-35c8d06b2951 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:49.809009 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e37d89e3-eadf-4842-87ba-35c8d06b2951 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:49.817848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e37d89e3-eadf-4842-87ba-35c8d06b2951 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.101097 Jul 04 06:12:49.818431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 811/1616] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:50.491142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3c801ad8-e834-49ef-be98-e2d34a33c17f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:50.492146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3c801ad8-e834-49ef-be98-e2d34a33c17f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:50.503201 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c801ad8-e834-49ef-be98-e2d34a33c17f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:50.503995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c801ad8-e834-49ef-be98-e2d34a33c17f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:50.505273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c801ad8-e834-49ef-be98-e2d34a33c17f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:50.505994 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c801ad8-e834-49ef-be98-e2d34a33c17f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:50.650912 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c801ad8-e834-49ef-be98-e2d34a33c17f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:50.660145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3c801ad8-e834-49ef-be98-e2d34a33c17f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.175552 Jul 04 06:12:50.660702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 806/1617] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:50 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:50.838381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f3d5f094-f3d0-4dc5-9ea8-d8cbfeec7386 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:50.839221 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f3d5f094-f3d0-4dc5-9ea8-d8cbfeec7386 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:50.847652 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3d5f094-f3d0-4dc5-9ea8-d8cbfeec7386 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:50.848093 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3d5f094-f3d0-4dc5-9ea8-d8cbfeec7386 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:50.848847 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3d5f094-f3d0-4dc5-9ea8-d8cbfeec7386 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:50.849272 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3d5f094-f3d0-4dc5-9ea8-d8cbfeec7386 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:50.912818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f3d5f094-f3d0-4dc5-9ea8-d8cbfeec7386 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:50.924702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f3d5f094-f3d0-4dc5-9ea8-d8cbfeec7386 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092625 Jul 04 06:12:50.925480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 812/1618] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:50 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:51.680715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-88b9c221-b9bd-4c87-8a65-e7eb1872d333 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:51.681694 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-88b9c221-b9bd-4c87-8a65-e7eb1872d333 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:51.690802 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88b9c221-b9bd-4c87-8a65-e7eb1872d333 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:51.691265 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88b9c221-b9bd-4c87-8a65-e7eb1872d333 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:51.692041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88b9c221-b9bd-4c87-8a65-e7eb1872d333 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:51.692471 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88b9c221-b9bd-4c87-8a65-e7eb1872d333 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:51.833979 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-88b9c221-b9bd-4c87-8a65-e7eb1872d333 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:51.842080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-88b9c221-b9bd-4c87-8a65-e7eb1872d333 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167863 Jul 04 06:12:51.842642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 807/1619] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:51 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:51.946042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f655196f-9ddc-4d3d-abef-68e403ad0522 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:51.947017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f655196f-9ddc-4d3d-abef-68e403ad0522 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:51.957686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f655196f-9ddc-4d3d-abef-68e403ad0522 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:51.958204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f655196f-9ddc-4d3d-abef-68e403ad0522 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:51.959430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f655196f-9ddc-4d3d-abef-68e403ad0522 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:51.960022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f655196f-9ddc-4d3d-abef-68e403ad0522 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:52.032535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f655196f-9ddc-4d3d-abef-68e403ad0522 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:52.040981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f655196f-9ddc-4d3d-abef-68e403ad0522 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.101687 Jul 04 06:12:52.041546 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 813/1620] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:51 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:52.864116 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-722d1889-707c-493d-b0d8-d90211d4d3ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:52.865036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-722d1889-707c-493d-b0d8-d90211d4d3ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:52.876157 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-722d1889-707c-493d-b0d8-d90211d4d3ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:52.876899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-722d1889-707c-493d-b0d8-d90211d4d3ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:52.878156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-722d1889-707c-493d-b0d8-d90211d4d3ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:52.878877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-722d1889-707c-493d-b0d8-d90211d4d3ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:53.028018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-722d1889-707c-493d-b0d8-d90211d4d3ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:53.036798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-722d1889-707c-493d-b0d8-d90211d4d3ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.179879 Jul 04 06:12:53.037379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 808/1621] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:52 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:53.056815 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9008278e-0900-4bf0-890d-d6511627ead7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:53.057393 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9008278e-0900-4bf0-890d-d6511627ead7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:53.064476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9008278e-0900-4bf0-890d-d6511627ead7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:53.064922 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9008278e-0900-4bf0-890d-d6511627ead7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:53.065684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9008278e-0900-4bf0-890d-d6511627ead7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:53.066111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9008278e-0900-4bf0-890d-d6511627ead7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:53.138636 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9008278e-0900-4bf0-890d-d6511627ead7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:53.147819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9008278e-0900-4bf0-890d-d6511627ead7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094686 Jul 04 06:12:53.148400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 814/1622] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:53 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:54.058157 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-84c78954-6108-40b4-b6e4-10717bd98c5b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:54.059157 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-84c78954-6108-40b4-b6e4-10717bd98c5b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:54.067277 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84c78954-6108-40b4-b6e4-10717bd98c5b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:54.067769 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84c78954-6108-40b4-b6e4-10717bd98c5b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:54.068537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84c78954-6108-40b4-b6e4-10717bd98c5b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:54.068975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84c78954-6108-40b4-b6e4-10717bd98c5b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:54.165167 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-df7f8cf1-0309-44df-9c2c-437258545d48 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:54.165734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-df7f8cf1-0309-44df-9c2c-437258545d48 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:54.172252 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df7f8cf1-0309-44df-9c2c-437258545d48 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:54.172709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df7f8cf1-0309-44df-9c2c-437258545d48 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:54.173449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df7f8cf1-0309-44df-9c2c-437258545d48 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:54.173918 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df7f8cf1-0309-44df-9c2c-437258545d48 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:54.205698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-84c78954-6108-40b4-b6e4-10717bd98c5b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:54.214284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-84c78954-6108-40b4-b6e4-10717bd98c5b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162608 Jul 04 06:12:54.214916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 809/1623] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:54 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:54.239277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df7f8cf1-0309-44df-9c2c-437258545d48 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:54.247761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-df7f8cf1-0309-44df-9c2c-437258545d48 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086445 Jul 04 06:12:54.248363 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 815/1624] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:55.235785 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-215aabac-763e-4755-b739-5c7126f62390 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:55.236786 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-215aabac-763e-4755-b739-5c7126f62390 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:55.247758 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-215aabac-763e-4755-b739-5c7126f62390 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:55.248475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-215aabac-763e-4755-b739-5c7126f62390 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:55.249877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-215aabac-763e-4755-b739-5c7126f62390 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:55.250309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-215aabac-763e-4755-b739-5c7126f62390 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:55.264868 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa1d6675-998e-48bc-b87d-525c0e09e62b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:55.265567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aa1d6675-998e-48bc-b87d-525c0e09e62b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:55.272372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa1d6675-998e-48bc-b87d-525c0e09e62b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:55.273008 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa1d6675-998e-48bc-b87d-525c0e09e62b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:55.273773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa1d6675-998e-48bc-b87d-525c0e09e62b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:55.274372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa1d6675-998e-48bc-b87d-525c0e09e62b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:55.337790 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aa1d6675-998e-48bc-b87d-525c0e09e62b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:55.348396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aa1d6675-998e-48bc-b87d-525c0e09e62b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087420 Jul 04 06:12:55.349011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 816/1625] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:55.390219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-215aabac-763e-4755-b739-5c7126f62390 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:55.398358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-215aabac-763e-4755-b739-5c7126f62390 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169008 Jul 04 06:12:55.398956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 810/1626] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:55 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:56.369891 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8db0d09d-088d-4d23-a970-45f73088c04a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:56.370908 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8db0d09d-088d-4d23-a970-45f73088c04a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:56.383881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8db0d09d-088d-4d23-a970-45f73088c04a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:56.384586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8db0d09d-088d-4d23-a970-45f73088c04a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:56.385871 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8db0d09d-088d-4d23-a970-45f73088c04a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:56.386578 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8db0d09d-088d-4d23-a970-45f73088c04a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:56.416389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42d5facc-e418-409c-aede-b1170994fea3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:56.416924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-42d5facc-e418-409c-aede-b1170994fea3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:56.423997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42d5facc-e418-409c-aede-b1170994fea3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:56.424543 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42d5facc-e418-409c-aede-b1170994fea3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:56.425400 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42d5facc-e418-409c-aede-b1170994fea3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:56.425901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42d5facc-e418-409c-aede-b1170994fea3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:56.451046 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8db0d09d-088d-4d23-a970-45f73088c04a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:56.459476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8db0d09d-088d-4d23-a970-45f73088c04a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095925 Jul 04 06:12:56.460059 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 817/1627] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:56 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:56.553211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-42d5facc-e418-409c-aede-b1170994fea3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:56.561517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-42d5facc-e418-409c-aede-b1170994fea3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.149091 Jul 04 06:12:56.562086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 811/1628] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:56 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:57.476424 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-615792ba-1742-4c95-82a1-b0e090f9ef69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:57.477073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-615792ba-1742-4c95-82a1-b0e090f9ef69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:57.484495 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-615792ba-1742-4c95-82a1-b0e090f9ef69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:57.484944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-615792ba-1742-4c95-82a1-b0e090f9ef69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:57.485736 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-615792ba-1742-4c95-82a1-b0e090f9ef69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:57.486149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-615792ba-1742-4c95-82a1-b0e090f9ef69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:57.548384 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-615792ba-1742-4c95-82a1-b0e090f9ef69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:57.556373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-615792ba-1742-4c95-82a1-b0e090f9ef69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.083928 Jul 04 06:12:57.556942 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 818/1629] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:57 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:57.578738 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a6ad6f77-2325-4451-a96e-d2259de3891f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:57.579415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a6ad6f77-2325-4451-a96e-d2259de3891f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:57.586040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6ad6f77-2325-4451-a96e-d2259de3891f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:57.586480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6ad6f77-2325-4451-a96e-d2259de3891f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:57.587290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6ad6f77-2325-4451-a96e-d2259de3891f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:57.587924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6ad6f77-2325-4451-a96e-d2259de3891f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:57.734402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6ad6f77-2325-4451-a96e-d2259de3891f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:57.742921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a6ad6f77-2325-4451-a96e-d2259de3891f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168116 Jul 04 06:12:57.743545 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 812/1630] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:57 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:58.576477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-577f0b50-9195-4aa5-b1ef-69170bbc9533 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:58.577521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-577f0b50-9195-4aa5-b1ef-69170bbc9533 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:58.585438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-577f0b50-9195-4aa5-b1ef-69170bbc9533 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:58.585892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-577f0b50-9195-4aa5-b1ef-69170bbc9533 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:58.586658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-577f0b50-9195-4aa5-b1ef-69170bbc9533 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:58.587085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-577f0b50-9195-4aa5-b1ef-69170bbc9533 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:58.654741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-577f0b50-9195-4aa5-b1ef-69170bbc9533 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:58.663038 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-577f0b50-9195-4aa5-b1ef-69170bbc9533 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093036 Jul 04 06:12:58.663622 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 819/1631] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:58.764645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2e029bee-fcaf-498e-b27c-5d515380fc0e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:58.765610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2e029bee-fcaf-498e-b27c-5d515380fc0e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:58.772843 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e029bee-fcaf-498e-b27c-5d515380fc0e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:58.773229 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e029bee-fcaf-498e-b27c-5d515380fc0e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:58.773992 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e029bee-fcaf-498e-b27c-5d515380fc0e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:58.774426 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e029bee-fcaf-498e-b27c-5d515380fc0e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:58.916737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2e029bee-fcaf-498e-b27c-5d515380fc0e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:58.926496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2e029bee-fcaf-498e-b27c-5d515380fc0e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168718 Jul 04 06:12:58.927067 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 813/1632] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:58 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:59.681643 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d9f8942d-0647-4b10-93fa-33bcca189941 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:59.682483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d9f8942d-0647-4b10-93fa-33bcca189941 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:59.691111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9f8942d-0647-4b10-93fa-33bcca189941 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:59.691588 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9f8942d-0647-4b10-93fa-33bcca189941 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:59.692337 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9f8942d-0647-4b10-93fa-33bcca189941 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:59.692761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9f8942d-0647-4b10-93fa-33bcca189941 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:59.764785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9f8942d-0647-4b10-93fa-33bcca189941 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:12:59.774193 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d9f8942d-0647-4b10-93fa-33bcca189941 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098420 Jul 04 06:12:59.774866 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 820/1633] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:12:59.944419 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e082910e-b000-454d-9ce8-9e606c7b44ef tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:12:59.944998 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e082910e-b000-454d-9ce8-9e606c7b44ef tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:12:59.952510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e082910e-b000-454d-9ce8-9e606c7b44ef tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:59.952960 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e082910e-b000-454d-9ce8-9e606c7b44ef tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:12:59.953718 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e082910e-b000-454d-9ce8-9e606c7b44ef tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:12:59.954145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e082910e-b000-454d-9ce8-9e606c7b44ef tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:00.110245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e082910e-b000-454d-9ce8-9e606c7b44ef tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:00.119533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e082910e-b000-454d-9ce8-9e606c7b44ef tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.179467 Jul 04 06:13:00.120107 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 814/1634] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:12:59 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:00.797726 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-00714514-d605-4e32-b1ff-5d1292970de7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:00.798614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-00714514-d605-4e32-b1ff-5d1292970de7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:00.806016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00714514-d605-4e32-b1ff-5d1292970de7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:00.806496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00714514-d605-4e32-b1ff-5d1292970de7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:00.807281 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00714514-d605-4e32-b1ff-5d1292970de7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:00.807732 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00714514-d605-4e32-b1ff-5d1292970de7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:00.883239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-00714514-d605-4e32-b1ff-5d1292970de7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:00.895414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-00714514-d605-4e32-b1ff-5d1292970de7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.104415 Jul 04 06:13:00.895989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 821/1635] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:00 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:01.141088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a8b34c0d-fa2f-4b88-87e3-0c0a5c9ef46e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:01.142020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a8b34c0d-fa2f-4b88-87e3-0c0a5c9ef46e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:01.149440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8b34c0d-fa2f-4b88-87e3-0c0a5c9ef46e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:01.150964 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8b34c0d-fa2f-4b88-87e3-0c0a5c9ef46e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:01.151931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8b34c0d-fa2f-4b88-87e3-0c0a5c9ef46e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:01.152370 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8b34c0d-fa2f-4b88-87e3-0c0a5c9ef46e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:01.282154 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a8b34c0d-fa2f-4b88-87e3-0c0a5c9ef46e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:01.290477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a8b34c0d-fa2f-4b88-87e3-0c0a5c9ef46e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156025 Jul 04 06:13:01.291047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 815/1636] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:01 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:01.915211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-37b9eb07-9dd4-4cd0-ac6c-3132e898b5f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:01.915945 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-37b9eb07-9dd4-4cd0-ac6c-3132e898b5f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:01.924358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37b9eb07-9dd4-4cd0-ac6c-3132e898b5f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:01.924956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37b9eb07-9dd4-4cd0-ac6c-3132e898b5f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:01.925919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37b9eb07-9dd4-4cd0-ac6c-3132e898b5f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:01.926462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37b9eb07-9dd4-4cd0-ac6c-3132e898b5f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:01.991352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-37b9eb07-9dd4-4cd0-ac6c-3132e898b5f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:02.003627 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-37b9eb07-9dd4-4cd0-ac6c-3132e898b5f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093360 Jul 04 06:13:02.004186 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 822/1637] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:01 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:02.311821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e847513b-5745-4077-99b0-3f0d8d4fc008 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:02.312980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e847513b-5745-4077-99b0-3f0d8d4fc008 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:02.324144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e847513b-5745-4077-99b0-3f0d8d4fc008 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:02.324880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e847513b-5745-4077-99b0-3f0d8d4fc008 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:02.326143 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e847513b-5745-4077-99b0-3f0d8d4fc008 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:02.326869 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e847513b-5745-4077-99b0-3f0d8d4fc008 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:02.460913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e847513b-5745-4077-99b0-3f0d8d4fc008 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:02.469681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e847513b-5745-4077-99b0-3f0d8d4fc008 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164530 Jul 04 06:13:02.470295 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 816/1638] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:02 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:03.022761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4861b10-54b7-492c-a832-56d61ff5a10c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:03.023395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f4861b10-54b7-492c-a832-56d61ff5a10c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:03.030770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4861b10-54b7-492c-a832-56d61ff5a10c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:03.031210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4861b10-54b7-492c-a832-56d61ff5a10c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:03.031995 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4861b10-54b7-492c-a832-56d61ff5a10c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:03.032416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4861b10-54b7-492c-a832-56d61ff5a10c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:03.104696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f4861b10-54b7-492c-a832-56d61ff5a10c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:03.113013 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f4861b10-54b7-492c-a832-56d61ff5a10c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095102 Jul 04 06:13:03.113595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 823/1639] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:03.487241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-acebc220-f1d0-4e84-b70f-4505e36ed0a5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:03.487880 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-acebc220-f1d0-4e84-b70f-4505e36ed0a5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:03.490263 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:13:03.495857 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acebc220-f1d0-4e84-b70f-4505e36ed0a5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:03.496301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acebc220-f1d0-4e84-b70f-4505e36ed0a5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:03.497052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acebc220-f1d0-4e84-b70f-4505e36ed0a5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:03.497477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acebc220-f1d0-4e84-b70f-4505e36ed0a5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:03.639826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-acebc220-f1d0-4e84-b70f-4505e36ed0a5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:03.648141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-acebc220-f1d0-4e84-b70f-4505e36ed0a5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164871 Jul 04 06:13:03.648703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 817/1640] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:03 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:04.134163 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-86971cb8-fbd3-4c2a-9134-9e5e11737bcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:04.135126 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-86971cb8-fbd3-4c2a-9134-9e5e11737bcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:04.145094 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86971cb8-fbd3-4c2a-9134-9e5e11737bcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:04.145538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86971cb8-fbd3-4c2a-9134-9e5e11737bcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:04.146299 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86971cb8-fbd3-4c2a-9134-9e5e11737bcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:04.146724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86971cb8-fbd3-4c2a-9134-9e5e11737bcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:04.214486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-86971cb8-fbd3-4c2a-9134-9e5e11737bcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:04.224387 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-86971cb8-fbd3-4c2a-9134-9e5e11737bcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096856 Jul 04 06:13:04.224968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 824/1641] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:04.670150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5ed4f385-58d9-4741-b17a-6a4c5db23200 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:04.671208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5ed4f385-58d9-4741-b17a-6a4c5db23200 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:04.680571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ed4f385-58d9-4741-b17a-6a4c5db23200 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:04.681095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ed4f385-58d9-4741-b17a-6a4c5db23200 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:04.681991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ed4f385-58d9-4741-b17a-6a4c5db23200 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:04.682477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ed4f385-58d9-4741-b17a-6a4c5db23200 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:04.828682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5ed4f385-58d9-4741-b17a-6a4c5db23200 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:04.837361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5ed4f385-58d9-4741-b17a-6a4c5db23200 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.173736 Jul 04 06:13:04.837930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 818/1642] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:04 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:05.243606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9fde5b12-c1f7-435f-b53c-5ebf568c295f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:05.244334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9fde5b12-c1f7-435f-b53c-5ebf568c295f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:05.252926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fde5b12-c1f7-435f-b53c-5ebf568c295f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:05.253398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fde5b12-c1f7-435f-b53c-5ebf568c295f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:05.254172 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fde5b12-c1f7-435f-b53c-5ebf568c295f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:05.254631 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fde5b12-c1f7-435f-b53c-5ebf568c295f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:05.325961 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9fde5b12-c1f7-435f-b53c-5ebf568c295f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:05.334748 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9fde5b12-c1f7-435f-b53c-5ebf568c295f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096103 Jul 04 06:13:05.335362 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 825/1643] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:05 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:05.858208 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8037bc13-f62f-4d56-9f59-10ea701d1af4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:05.859123 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8037bc13-f62f-4d56-9f59-10ea701d1af4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:05.870186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8037bc13-f62f-4d56-9f59-10ea701d1af4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:05.870950 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8037bc13-f62f-4d56-9f59-10ea701d1af4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:05.872248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8037bc13-f62f-4d56-9f59-10ea701d1af4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:05.872972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8037bc13-f62f-4d56-9f59-10ea701d1af4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:06.017135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8037bc13-f62f-4d56-9f59-10ea701d1af4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:06.025632 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8037bc13-f62f-4d56-9f59-10ea701d1af4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.174083 Jul 04 06:13:06.026246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 819/1644] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:05 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:06.355999 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bf450514-4d39-4c35-a5a3-d6956093b692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:06.357018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bf450514-4d39-4c35-a5a3-d6956093b692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:06.360703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:13:06.368445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf450514-4d39-4c35-a5a3-d6956093b692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:06.369018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf450514-4d39-4c35-a5a3-d6956093b692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:06.370176 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf450514-4d39-4c35-a5a3-d6956093b692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:06.370805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf450514-4d39-4c35-a5a3-d6956093b692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:06.375055 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:13:06.438539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bf450514-4d39-4c35-a5a3-d6956093b692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:06.447137 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bf450514-4d39-4c35-a5a3-d6956093b692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098085 Jul 04 06:13:06.447761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 826/1645] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:07.048798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0d4baf7b-1239-4bae-8610-bb731d09df77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:07.049902 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0d4baf7b-1239-4bae-8610-bb731d09df77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:07.057127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d4baf7b-1239-4bae-8610-bb731d09df77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:07.057601 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d4baf7b-1239-4bae-8610-bb731d09df77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:07.058416 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d4baf7b-1239-4bae-8610-bb731d09df77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:07.058879 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d4baf7b-1239-4bae-8610-bb731d09df77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:07.202125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0d4baf7b-1239-4bae-8610-bb731d09df77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:07.210546 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0d4baf7b-1239-4bae-8610-bb731d09df77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168252 Jul 04 06:13:07.211118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 820/1646] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:07 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:07.465473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-16979e80-d26a-4a4b-9eed-5c745853054d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:07.466067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-16979e80-d26a-4a4b-9eed-5c745853054d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:07.473246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16979e80-d26a-4a4b-9eed-5c745853054d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:07.473730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16979e80-d26a-4a4b-9eed-5c745853054d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:07.474488 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16979e80-d26a-4a4b-9eed-5c745853054d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:07.474920 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16979e80-d26a-4a4b-9eed-5c745853054d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:07.540999 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-16979e80-d26a-4a4b-9eed-5c745853054d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:07.549232 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-16979e80-d26a-4a4b-9eed-5c745853054d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087778 Jul 04 06:13:07.549858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 827/1647] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:08.232057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bbbdb903-aea1-47fe-8f85-7a3a9ffb1833 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:08.233006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bbbdb903-aea1-47fe-8f85-7a3a9ffb1833 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:08.244145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbbdb903-aea1-47fe-8f85-7a3a9ffb1833 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:08.244890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbbdb903-aea1-47fe-8f85-7a3a9ffb1833 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:08.246614 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbbdb903-aea1-47fe-8f85-7a3a9ffb1833 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:08.247399 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbbdb903-aea1-47fe-8f85-7a3a9ffb1833 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:08.251609 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:13:08.395150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bbbdb903-aea1-47fe-8f85-7a3a9ffb1833 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:08.404201 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bbbdb903-aea1-47fe-8f85-7a3a9ffb1833 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.178361 Jul 04 06:13:08.404776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 821/1648] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:08 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:08.566365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1cd853ac-26fc-48a3-9f89-3e9c3ffda5ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:08.566983 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1cd853ac-26fc-48a3-9f89-3e9c3ffda5ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:08.573939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cd853ac-26fc-48a3-9f89-3e9c3ffda5ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:08.574391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cd853ac-26fc-48a3-9f89-3e9c3ffda5ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:08.575158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cd853ac-26fc-48a3-9f89-3e9c3ffda5ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:08.575603 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cd853ac-26fc-48a3-9f89-3e9c3ffda5ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:08.637857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1cd853ac-26fc-48a3-9f89-3e9c3ffda5ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:08.649731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1cd853ac-26fc-48a3-9f89-3e9c3ffda5ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086998 Jul 04 06:13:08.650509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 828/1649] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:08 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:09.426221 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-919d4f9f-8bf0-468e-9a7c-65f3218223eb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:09.427297 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-919d4f9f-8bf0-468e-9a7c-65f3218223eb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:09.444561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-919d4f9f-8bf0-468e-9a7c-65f3218223eb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:09.445371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-919d4f9f-8bf0-468e-9a7c-65f3218223eb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:09.446756 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-919d4f9f-8bf0-468e-9a7c-65f3218223eb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:09.447585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-919d4f9f-8bf0-468e-9a7c-65f3218223eb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:09.587109 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-919d4f9f-8bf0-468e-9a7c-65f3218223eb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:09.595280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-919d4f9f-8bf0-468e-9a7c-65f3218223eb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.176132 Jul 04 06:13:09.595860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 822/1650] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:09 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:09.673982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f16faba2-997f-48d5-af54-e6b18e908f2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:09.675042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f16faba2-997f-48d5-af54-e6b18e908f2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:09.686029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f16faba2-997f-48d5-af54-e6b18e908f2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:09.686675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f16faba2-997f-48d5-af54-e6b18e908f2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:09.688001 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f16faba2-997f-48d5-af54-e6b18e908f2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:09.688728 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f16faba2-997f-48d5-af54-e6b18e908f2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:09.763602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f16faba2-997f-48d5-af54-e6b18e908f2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:09.773204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f16faba2-997f-48d5-af54-e6b18e908f2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.105704 Jul 04 06:13:09.773776 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 829/1651] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:10.612913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3f0ab13c-555d-40ec-ad23-c623a52b682a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:10.613599 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3f0ab13c-555d-40ec-ad23-c623a52b682a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:10.620698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f0ab13c-555d-40ec-ad23-c623a52b682a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:10.621147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f0ab13c-555d-40ec-ad23-c623a52b682a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:10.621934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f0ab13c-555d-40ec-ad23-c623a52b682a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:10.622366 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f0ab13c-555d-40ec-ad23-c623a52b682a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:10.766677 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3f0ab13c-555d-40ec-ad23-c623a52b682a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:10.774809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3f0ab13c-555d-40ec-ad23-c623a52b682a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165897 Jul 04 06:13:10.775296 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 823/1652] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:10 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:10.789939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bba80045-13c6-4e53-a195-4a14610ce367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:10.790502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bba80045-13c6-4e53-a195-4a14610ce367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:10.797629 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bba80045-13c6-4e53-a195-4a14610ce367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:10.798080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bba80045-13c6-4e53-a195-4a14610ce367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:10.798850 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bba80045-13c6-4e53-a195-4a14610ce367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:10.799279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bba80045-13c6-4e53-a195-4a14610ce367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:10.861034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bba80045-13c6-4e53-a195-4a14610ce367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:10.872437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bba80045-13c6-4e53-a195-4a14610ce367 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086156 Jul 04 06:13:10.873259 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 830/1653] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:10 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:11.792734 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e651b9cb-f613-4acb-8620-b8853f6b9388 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:11.793310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e651b9cb-f613-4acb-8620-b8853f6b9388 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:11.800144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e651b9cb-f613-4acb-8620-b8853f6b9388 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:11.800593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e651b9cb-f613-4acb-8620-b8853f6b9388 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:11.801331 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e651b9cb-f613-4acb-8620-b8853f6b9388 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:11.801765 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e651b9cb-f613-4acb-8620-b8853f6b9388 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:11.891127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b470f60b-a80f-4a52-8f83-347467bee23e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:11.891753 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b470f60b-a80f-4a52-8f83-347467bee23e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:11.898784 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b470f60b-a80f-4a52-8f83-347467bee23e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:11.899274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b470f60b-a80f-4a52-8f83-347467bee23e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:11.900042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b470f60b-a80f-4a52-8f83-347467bee23e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:11.900465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b470f60b-a80f-4a52-8f83-347467bee23e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:11.936502 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e651b9cb-f613-4acb-8620-b8853f6b9388 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:11.944939 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e651b9cb-f613-4acb-8620-b8853f6b9388 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156147 Jul 04 06:13:11.945714 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 824/1654] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:11 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:11.964973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b470f60b-a80f-4a52-8f83-347467bee23e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:11.973988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b470f60b-a80f-4a52-8f83-347467bee23e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086852 Jul 04 06:13:11.974560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 831/1655] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:11 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:12.963128 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f40224bc-294c-49cc-aea5-e4bf9a9f8fb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:12.963763 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f40224bc-294c-49cc-aea5-e4bf9a9f8fb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:12.971006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f40224bc-294c-49cc-aea5-e4bf9a9f8fb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:12.971489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f40224bc-294c-49cc-aea5-e4bf9a9f8fb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:12.972248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f40224bc-294c-49cc-aea5-e4bf9a9f8fb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:12.972707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f40224bc-294c-49cc-aea5-e4bf9a9f8fb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:12.990448 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-082cb9af-8680-4068-ae9e-33b3e6f76320 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:12.991139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-082cb9af-8680-4068-ae9e-33b3e6f76320 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:12.998044 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-082cb9af-8680-4068-ae9e-33b3e6f76320 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:12.998481 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-082cb9af-8680-4068-ae9e-33b3e6f76320 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:12.999284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-082cb9af-8680-4068-ae9e-33b3e6f76320 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:12.999747 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-082cb9af-8680-4068-ae9e-33b3e6f76320 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:13.063078 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-082cb9af-8680-4068-ae9e-33b3e6f76320 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:13.072206 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-082cb9af-8680-4068-ae9e-33b3e6f76320 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085701 Jul 04 06:13:13.072794 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 832/1656] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:12 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:13.107730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f40224bc-294c-49cc-aea5-e4bf9a9f8fb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:13.116017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f40224bc-294c-49cc-aea5-e4bf9a9f8fb4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.157023 Jul 04 06:13:13.116591 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 825/1657] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:12 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:14.093246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5eb9c3b7-8486-46ea-8e6d-52455ce1e9a8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:14.094232 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5eb9c3b7-8486-46ea-8e6d-52455ce1e9a8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:14.104532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5eb9c3b7-8486-46ea-8e6d-52455ce1e9a8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:14.105222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5eb9c3b7-8486-46ea-8e6d-52455ce1e9a8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:14.106136 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5eb9c3b7-8486-46ea-8e6d-52455ce1e9a8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:14.106694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5eb9c3b7-8486-46ea-8e6d-52455ce1e9a8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:14.133126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5292f7af-833c-4742-9b0b-6f4afb482b23 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:14.133696 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5292f7af-833c-4742-9b0b-6f4afb482b23 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:14.140752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5292f7af-833c-4742-9b0b-6f4afb482b23 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:14.141204 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5292f7af-833c-4742-9b0b-6f4afb482b23 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:14.141977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5292f7af-833c-4742-9b0b-6f4afb482b23 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:14.142412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5292f7af-833c-4742-9b0b-6f4afb482b23 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:14.177451 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5eb9c3b7-8486-46ea-8e6d-52455ce1e9a8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:14.185571 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5eb9c3b7-8486-46ea-8e6d-52455ce1e9a8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098805 Jul 04 06:13:14.186143 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 833/1658] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:14 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:14.276539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5292f7af-833c-4742-9b0b-6f4afb482b23 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:14.285657 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5292f7af-833c-4742-9b0b-6f4afb482b23 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156525 Jul 04 06:13:14.286227 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 826/1659] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:14 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:15.206701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a5d94d39-5e84-43c4-8f71-6c538650f3e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:15.207683 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a5d94d39-5e84-43c4-8f71-6c538650f3e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:15.215530 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5d94d39-5e84-43c4-8f71-6c538650f3e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:15.216001 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5d94d39-5e84-43c4-8f71-6c538650f3e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:15.216886 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5d94d39-5e84-43c4-8f71-6c538650f3e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:15.217389 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5d94d39-5e84-43c4-8f71-6c538650f3e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:15.286443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a5d94d39-5e84-43c4-8f71-6c538650f3e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:15.294506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a5d94d39-5e84-43c4-8f71-6c538650f3e5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094949 Jul 04 06:13:15.295111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 834/1660] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:15.302435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2ecefca6-5d09-4ca5-9ccd-a97f4dde0e99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:15.303046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2ecefca6-5d09-4ca5-9ccd-a97f4dde0e99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:15.309973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ecefca6-5d09-4ca5-9ccd-a97f4dde0e99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:15.310429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ecefca6-5d09-4ca5-9ccd-a97f4dde0e99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:15.311190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ecefca6-5d09-4ca5-9ccd-a97f4dde0e99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:15.311652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ecefca6-5d09-4ca5-9ccd-a97f4dde0e99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:15.444238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2ecefca6-5d09-4ca5-9ccd-a97f4dde0e99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:15.452690 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2ecefca6-5d09-4ca5-9ccd-a97f4dde0e99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.154263 Jul 04 06:13:15.453253 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 827/1661] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:15 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:16.314600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e8e39f3d-b8a7-4667-bef8-f2e7a2aad062 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:16.315608 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e8e39f3d-b8a7-4667-bef8-f2e7a2aad062 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:16.324480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8e39f3d-b8a7-4667-bef8-f2e7a2aad062 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:16.324932 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8e39f3d-b8a7-4667-bef8-f2e7a2aad062 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:16.325703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8e39f3d-b8a7-4667-bef8-f2e7a2aad062 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:16.326135 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8e39f3d-b8a7-4667-bef8-f2e7a2aad062 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:16.390416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e8e39f3d-b8a7-4667-bef8-f2e7a2aad062 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:16.398743 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e8e39f3d-b8a7-4667-bef8-f2e7a2aad062 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090667 Jul 04 06:13:16.399308 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 835/1662] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:16.473653 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-697966a2-0c48-479a-8678-c2cfbbd8e415 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:16.474292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-697966a2-0c48-479a-8678-c2cfbbd8e415 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:16.481192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-697966a2-0c48-479a-8678-c2cfbbd8e415 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:16.481636 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-697966a2-0c48-479a-8678-c2cfbbd8e415 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:16.482396 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-697966a2-0c48-479a-8678-c2cfbbd8e415 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:16.482826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-697966a2-0c48-479a-8678-c2cfbbd8e415 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:16.613529 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-697966a2-0c48-479a-8678-c2cfbbd8e415 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:16.621470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-697966a2-0c48-479a-8678-c2cfbbd8e415 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.154138 Jul 04 06:13:16.622015 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 828/1663] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:16 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:17.419236 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c1dc05ab-bb72-4fa4-a116-97db2d1d587a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:17.420195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c1dc05ab-bb72-4fa4-a116-97db2d1d587a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:17.429443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1dc05ab-bb72-4fa4-a116-97db2d1d587a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:17.429898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1dc05ab-bb72-4fa4-a116-97db2d1d587a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:17.430661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1dc05ab-bb72-4fa4-a116-97db2d1d587a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:17.431097 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1dc05ab-bb72-4fa4-a116-97db2d1d587a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:17.492467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c1dc05ab-bb72-4fa4-a116-97db2d1d587a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:17.502543 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c1dc05ab-bb72-4fa4-a116-97db2d1d587a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089752 Jul 04 06:13:17.503139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 836/1664] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:17.645713 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8bec80f-c8d9-4c8e-a27b-c3f6cb07c63e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:17.646429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8bec80f-c8d9-4c8e-a27b-c3f6cb07c63e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:17.655470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8bec80f-c8d9-4c8e-a27b-c3f6cb07c63e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:17.656252 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8bec80f-c8d9-4c8e-a27b-c3f6cb07c63e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:17.657092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8bec80f-c8d9-4c8e-a27b-c3f6cb07c63e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:17.658330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8bec80f-c8d9-4c8e-a27b-c3f6cb07c63e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:17.793700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8bec80f-c8d9-4c8e-a27b-c3f6cb07c63e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:17.802676 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8bec80f-c8d9-4c8e-a27b-c3f6cb07c63e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.161252 Jul 04 06:13:17.803287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 829/1665] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:17 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:18.523900 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-24783cd9-d379-42d9-81e6-3dd435f5fd55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:18.524901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-24783cd9-d379-42d9-81e6-3dd435f5fd55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:18.535961 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24783cd9-d379-42d9-81e6-3dd435f5fd55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:18.536435 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24783cd9-d379-42d9-81e6-3dd435f5fd55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:18.537206 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24783cd9-d379-42d9-81e6-3dd435f5fd55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:18.537634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24783cd9-d379-42d9-81e6-3dd435f5fd55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:18.598865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-24783cd9-d379-42d9-81e6-3dd435f5fd55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:18.606976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-24783cd9-d379-42d9-81e6-3dd435f5fd55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089790 Jul 04 06:13:18.607584 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 837/1666] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:18.828924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-76506dec-fb6c-4fc9-a117-78b875b1bca5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:18.829791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-76506dec-fb6c-4fc9-a117-78b875b1bca5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:18.837700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76506dec-fb6c-4fc9-a117-78b875b1bca5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:18.838143 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76506dec-fb6c-4fc9-a117-78b875b1bca5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:18.838897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76506dec-fb6c-4fc9-a117-78b875b1bca5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:18.839352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76506dec-fb6c-4fc9-a117-78b875b1bca5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:18.992381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-76506dec-fb6c-4fc9-a117-78b875b1bca5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:19.004566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-76506dec-fb6c-4fc9-a117-78b875b1bca5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.182241 Jul 04 06:13:19.005190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 830/1667] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:18 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:19.627842 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-513b0799-f567-465d-8e99-3587b5501e97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:19.628767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-513b0799-f567-465d-8e99-3587b5501e97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:19.640060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-513b0799-f567-465d-8e99-3587b5501e97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:19.640799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-513b0799-f567-465d-8e99-3587b5501e97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:19.642049 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-513b0799-f567-465d-8e99-3587b5501e97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:19.642767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-513b0799-f567-465d-8e99-3587b5501e97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:19.714146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-513b0799-f567-465d-8e99-3587b5501e97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:19.722550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-513b0799-f567-465d-8e99-3587b5501e97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.101223 Jul 04 06:13:19.723130 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 838/1668] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:20.025508 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-417b8609-5ecc-4164-91e4-b9165d4ef7fc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:20.026468 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-417b8609-5ecc-4164-91e4-b9165d4ef7fc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:20.037299 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-417b8609-5ecc-4164-91e4-b9165d4ef7fc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:20.037741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-417b8609-5ecc-4164-91e4-b9165d4ef7fc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:20.038525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-417b8609-5ecc-4164-91e4-b9165d4ef7fc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:20.038952 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-417b8609-5ecc-4164-91e4-b9165d4ef7fc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:20.182828 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-417b8609-5ecc-4164-91e4-b9165d4ef7fc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:20.190955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-417b8609-5ecc-4164-91e4-b9165d4ef7fc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.171946 Jul 04 06:13:20.191551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 831/1669] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:20 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:20.743035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ae8b1a02-1733-4496-b50f-7dc8b2985fae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:20.744135 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ae8b1a02-1733-4496-b50f-7dc8b2985fae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:20.754905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae8b1a02-1733-4496-b50f-7dc8b2985fae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:20.755381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae8b1a02-1733-4496-b50f-7dc8b2985fae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:20.756135 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae8b1a02-1733-4496-b50f-7dc8b2985fae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:20.756560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae8b1a02-1733-4496-b50f-7dc8b2985fae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:20.839007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae8b1a02-1733-4496-b50f-7dc8b2985fae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:20.852162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ae8b1a02-1733-4496-b50f-7dc8b2985fae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.115690 Jul 04 06:13:20.857047 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 839/1670] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:20 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:21.209579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7e79ccfc-9687-40eb-b47f-bc84e6389d30 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:21.210254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7e79ccfc-9687-40eb-b47f-bc84e6389d30 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:21.217859 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e79ccfc-9687-40eb-b47f-bc84e6389d30 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:21.218359 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e79ccfc-9687-40eb-b47f-bc84e6389d30 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:21.219212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e79ccfc-9687-40eb-b47f-bc84e6389d30 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:21.219737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e79ccfc-9687-40eb-b47f-bc84e6389d30 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:21.350805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7e79ccfc-9687-40eb-b47f-bc84e6389d30 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:21.358855 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7e79ccfc-9687-40eb-b47f-bc84e6389d30 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.153717 Jul 04 06:13:21.359489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 832/1671] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:21 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:21.478104 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5f1411dd-9f67-4c0d-8de8-3769836b26ca tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:21.478607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5f1411dd-9f67-4c0d-8de8-3769836b26ca tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:21.484925 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f1411dd-9f67-4c0d-8de8-3769836b26ca tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:21.485552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f1411dd-9f67-4c0d-8de8-3769836b26ca tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:21.486321 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f1411dd-9f67-4c0d-8de8-3769836b26ca tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:21.486754 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f1411dd-9f67-4c0d-8de8-3769836b26ca tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-5f1411dd-9f67-4c0d-8de8-3769836b26ca tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] HTTP exception thrown: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5f1411dd-9f67-4c0d-8de8-3769836b26ca tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Request method failure captured: Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd HTTP/1.1 Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoCEUy_tkDjUbVKcexapYDAsm40eALAF_dR72XCRiPOAjjY_kvltuR8PCLFjH0f4aNu7xrSw_7JDtTHQcBWxoA1U4NVcaSanOU_o948upgIv2ysLLAABEBrFpimbso2wYYcX-Syirc3zdf6h3irlfBmfus4yp-93Cx-MzRohzZ4xanY Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 06:13:21.508294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 32703b5451cf48b09966a7412b747099 Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:13:21.510489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '6c1202bc-e2f9-4a89-b2da-819b3132f5bd'} Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:13:21.511396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:13:21.512854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:13:21.514290 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5f1411dd-9f67-4c0d-8de8-3769836b26ca tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Returning 404 to user: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:13:21.514290 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5f1411dd-9f67-4c0d-8de8-3769836b26ca tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 404 len: 111 microversion: 2.1 time: 0.029264 Jul 04 06:13:21.514290 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 840/1672] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:13:21 2022] DELETE /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:13:21.514547 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c8368c28-9f03-48d7-97fe-8e533e13e17c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:21.515020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c8368c28-9f03-48d7-97fe-8e533e13e17c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 6c1202bc-e2f9-4a89-b2da-819b3132f5bd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:21.525493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8368c28-9f03-48d7-97fe-8e533e13e17c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:21.525948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8368c28-9f03-48d7-97fe-8e533e13e17c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:21.526759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8368c28-9f03-48d7-97fe-8e533e13e17c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:21.527165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8368c28-9f03-48d7-97fe-8e533e13e17c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:21.544488 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-c8368c28-9f03-48d7-97fe-8e533e13e17c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] HTTP exception thrown: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c8368c28-9f03-48d7-97fe-8e533e13e17c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Request method failure captured: Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd HTTP/1.1 Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoCEUy_tkDjUbVKcexapYDAsm40eALAF_dR72XCRiPOAjjY_kvltuR8PCLFjH0f4aNu7xrSw_7JDtTHQcBWxoA1U4NVcaSanOU_o948upgIv2ysLLAABEBrFpimbso2wYYcX-Syirc3zdf6h3irlfBmfus4yp-93Cx-MzRohzZ4xanY Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:13:21.546127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 32703b5451cf48b09966a7412b747099 Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:13:21.547751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '6c1202bc-e2f9-4a89-b2da-819b3132f5bd'} Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:13:21.548764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. Jul 04 06:13:21.550146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:13:21.551421 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c8368c28-9f03-48d7-97fe-8e533e13e17c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Returning 404 to user: Instance 6c1202bc-e2f9-4a89-b2da-819b3132f5bd could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:13:21.551421 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c8368c28-9f03-48d7-97fe-8e533e13e17c tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd" status: 404 len: 111 microversion: 2.1 time: 0.036956 Jul 04 06:13:21.551421 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 833/1673] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:21 2022] GET /compute/v2.1/servers/6c1202bc-e2f9-4a89-b2da-819b3132f5bd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:13:21.873669 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-582a9887-0535-4fe0-9944-86ad0f341dd2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:21.874323 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-582a9887-0535-4fe0-9944-86ad0f341dd2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:21.884825 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-582a9887-0535-4fe0-9944-86ad0f341dd2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:21.885562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-582a9887-0535-4fe0-9944-86ad0f341dd2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:21.886817 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-582a9887-0535-4fe0-9944-86ad0f341dd2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:21.887586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-582a9887-0535-4fe0-9944-86ad0f341dd2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:21.953787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-582a9887-0535-4fe0-9944-86ad0f341dd2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:21.961951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-582a9887-0535-4fe0-9944-86ad0f341dd2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095466 Jul 04 06:13:21.962508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 841/1674] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:22.380420 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ccff3387-c55f-4fa6-b95f-0f22eeb6a582 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:22.381492 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ccff3387-c55f-4fa6-b95f-0f22eeb6a582 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:22.390391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccff3387-c55f-4fa6-b95f-0f22eeb6a582 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:22.391161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccff3387-c55f-4fa6-b95f-0f22eeb6a582 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:22.392189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccff3387-c55f-4fa6-b95f-0f22eeb6a582 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:22.392760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccff3387-c55f-4fa6-b95f-0f22eeb6a582 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:22.533700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ccff3387-c55f-4fa6-b95f-0f22eeb6a582 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:22.541814 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ccff3387-c55f-4fa6-b95f-0f22eeb6a582 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167991 Jul 04 06:13:22.542364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 834/1675] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:22 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:22.982812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-55b670ba-e2ed-4c36-9b93-1c7b84251d90 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:22.984360 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-55b670ba-e2ed-4c36-9b93-1c7b84251d90 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:22.995490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55b670ba-e2ed-4c36-9b93-1c7b84251d90 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:22.996238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55b670ba-e2ed-4c36-9b93-1c7b84251d90 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:22.997499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55b670ba-e2ed-4c36-9b93-1c7b84251d90 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:22.998220 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55b670ba-e2ed-4c36-9b93-1c7b84251d90 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:23.062960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-55b670ba-e2ed-4c36-9b93-1c7b84251d90 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:23.071490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-55b670ba-e2ed-4c36-9b93-1c7b84251d90 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095071 Jul 04 06:13:23.072074 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 842/1676] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:23.565594 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c36066ca-c114-4410-83f3-6a15a19019d9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:23.567224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c36066ca-c114-4410-83f3-6a15a19019d9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:23.575831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c36066ca-c114-4410-83f3-6a15a19019d9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:23.576316 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c36066ca-c114-4410-83f3-6a15a19019d9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:23.577092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c36066ca-c114-4410-83f3-6a15a19019d9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:23.577527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c36066ca-c114-4410-83f3-6a15a19019d9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:23.718599 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c36066ca-c114-4410-83f3-6a15a19019d9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:23.729486 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c36066ca-c114-4410-83f3-6a15a19019d9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.172895 Jul 04 06:13:23.730059 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 835/1677] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:23 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:24.092658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-db8b841d-ba5e-42ff-a261-711f086aec8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:24.093621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-db8b841d-ba5e-42ff-a261-711f086aec8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:24.104575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db8b841d-ba5e-42ff-a261-711f086aec8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:24.105310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db8b841d-ba5e-42ff-a261-711f086aec8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:24.106810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db8b841d-ba5e-42ff-a261-711f086aec8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:24.107594 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db8b841d-ba5e-42ff-a261-711f086aec8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:24.125358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:13:24.173867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-db8b841d-ba5e-42ff-a261-711f086aec8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:24.183613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-db8b841d-ba5e-42ff-a261-711f086aec8e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097718 Jul 04 06:13:24.184301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 843/1678] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:24.751021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4f00f2fe-631f-43c9-afa1-15fcf8c8d496 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:24.752114 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4f00f2fe-631f-43c9-afa1-15fcf8c8d496 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:24.763328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f00f2fe-631f-43c9-afa1-15fcf8c8d496 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:24.764088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f00f2fe-631f-43c9-afa1-15fcf8c8d496 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:24.765358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f00f2fe-631f-43c9-afa1-15fcf8c8d496 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:24.766083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f00f2fe-631f-43c9-afa1-15fcf8c8d496 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:24.911002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4f00f2fe-631f-43c9-afa1-15fcf8c8d496 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:24.919509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4f00f2fe-631f-43c9-afa1-15fcf8c8d496 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.174994 Jul 04 06:13:24.920084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 836/1679] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:24 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:25.203815 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a07fbdf3-cb76-4022-9fdb-0f320b8ada05 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:25.204710 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a07fbdf3-cb76-4022-9fdb-0f320b8ada05 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:25.215742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a07fbdf3-cb76-4022-9fdb-0f320b8ada05 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:25.216484 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a07fbdf3-cb76-4022-9fdb-0f320b8ada05 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:25.217741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a07fbdf3-cb76-4022-9fdb-0f320b8ada05 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:25.218441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a07fbdf3-cb76-4022-9fdb-0f320b8ada05 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:25.286681 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a07fbdf3-cb76-4022-9fdb-0f320b8ada05 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:25.295111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a07fbdf3-cb76-4022-9fdb-0f320b8ada05 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097981 Jul 04 06:13:25.295723 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 844/1680] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:25.945170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-733deeb6-de4d-4662-b27b-c0e9b100a19e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:25.945757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-733deeb6-de4d-4662-b27b-c0e9b100a19e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:25.952762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-733deeb6-de4d-4662-b27b-c0e9b100a19e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:25.953216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-733deeb6-de4d-4662-b27b-c0e9b100a19e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:25.953982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-733deeb6-de4d-4662-b27b-c0e9b100a19e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:25.954417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-733deeb6-de4d-4662-b27b-c0e9b100a19e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:26.087024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-733deeb6-de4d-4662-b27b-c0e9b100a19e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:26.095574 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-733deeb6-de4d-4662-b27b-c0e9b100a19e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.157411 Jul 04 06:13:26.096153 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 837/1681] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:25 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:26.315203 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-29203d6f-a885-4bdf-b668-dec70ff5cf18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:26.315895 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-29203d6f-a885-4bdf-b668-dec70ff5cf18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:26.326342 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29203d6f-a885-4bdf-b668-dec70ff5cf18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:26.327543 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29203d6f-a885-4bdf-b668-dec70ff5cf18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:26.328758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29203d6f-a885-4bdf-b668-dec70ff5cf18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:26.329368 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29203d6f-a885-4bdf-b668-dec70ff5cf18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:26.393728 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29203d6f-a885-4bdf-b668-dec70ff5cf18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:26.402227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-29203d6f-a885-4bdf-b668-dec70ff5cf18 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093501 Jul 04 06:13:26.402786 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 845/1682] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:27.116798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f75f8dbe-7648-47c2-b4c7-ab738d52e4a2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:27.117491 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f75f8dbe-7648-47c2-b4c7-ab738d52e4a2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:27.125889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f75f8dbe-7648-47c2-b4c7-ab738d52e4a2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:27.126455 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f75f8dbe-7648-47c2-b4c7-ab738d52e4a2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:27.127457 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f75f8dbe-7648-47c2-b4c7-ab738d52e4a2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:27.128006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f75f8dbe-7648-47c2-b4c7-ab738d52e4a2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:27.146409 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:13:27.266552 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f75f8dbe-7648-47c2-b4c7-ab738d52e4a2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:27.275597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f75f8dbe-7648-47c2-b4c7-ab738d52e4a2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165148 Jul 04 06:13:27.276170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 838/1683] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:27 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:27.423927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ad66bd50-48f5-493f-a298-025d9ad874b0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:27.424844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ad66bd50-48f5-493f-a298-025d9ad874b0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:27.435938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad66bd50-48f5-493f-a298-025d9ad874b0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:27.436686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad66bd50-48f5-493f-a298-025d9ad874b0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:27.437952 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad66bd50-48f5-493f-a298-025d9ad874b0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:27.438669 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad66bd50-48f5-493f-a298-025d9ad874b0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:27.505498 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad66bd50-48f5-493f-a298-025d9ad874b0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:27.513912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ad66bd50-48f5-493f-a298-025d9ad874b0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096731 Jul 04 06:13:27.514522 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 846/1684] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:28.297752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92ee9120-8f44-4ed6-9b37-9c07562fc8db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:28.298640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92ee9120-8f44-4ed6-9b37-9c07562fc8db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:28.309129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92ee9120-8f44-4ed6-9b37-9c07562fc8db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:28.309878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92ee9120-8f44-4ed6-9b37-9c07562fc8db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:28.311134 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92ee9120-8f44-4ed6-9b37-9c07562fc8db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:28.311910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92ee9120-8f44-4ed6-9b37-9c07562fc8db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:28.455101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-92ee9120-8f44-4ed6-9b37-9c07562fc8db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:28.464651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92ee9120-8f44-4ed6-9b37-9c07562fc8db tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.173602 Jul 04 06:13:28.465221 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 839/1685] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:28 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:28.530560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-28254457-0cb5-47a3-8a4a-a7ecc8c0047c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:28.531196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-28254457-0cb5-47a3-8a4a-a7ecc8c0047c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:28.538275 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28254457-0cb5-47a3-8a4a-a7ecc8c0047c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:28.538720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28254457-0cb5-47a3-8a4a-a7ecc8c0047c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:28.539655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28254457-0cb5-47a3-8a4a-a7ecc8c0047c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:28.540086 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28254457-0cb5-47a3-8a4a-a7ecc8c0047c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:28.767614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-28254457-0cb5-47a3-8a4a-a7ecc8c0047c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:28.775790 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-28254457-0cb5-47a3-8a4a-a7ecc8c0047c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.249533 Jul 04 06:13:28.776375 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 847/1686] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:29.483237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5beb49a-0179-4ea8-a6db-be5413dd61d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:29.483870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d5beb49a-0179-4ea8-a6db-be5413dd61d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:29.491762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5beb49a-0179-4ea8-a6db-be5413dd61d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:29.492210 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5beb49a-0179-4ea8-a6db-be5413dd61d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:29.492980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5beb49a-0179-4ea8-a6db-be5413dd61d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:29.493415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5beb49a-0179-4ea8-a6db-be5413dd61d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:29.796361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d5beb49a-0179-4ea8-a6db-be5413dd61d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:29.800684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7d546e52-e73b-46c5-9ba3-6c3a3f5eafa3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:29.801712 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7d546e52-e73b-46c5-9ba3-6c3a3f5eafa3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:29.809405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d5beb49a-0179-4ea8-a6db-be5413dd61d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.330531 Jul 04 06:13:29.810304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 840/1687] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:29 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:29.813009 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d546e52-e73b-46c5-9ba3-6c3a3f5eafa3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:29.813758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d546e52-e73b-46c5-9ba3-6c3a3f5eafa3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:29.815018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d546e52-e73b-46c5-9ba3-6c3a3f5eafa3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:29.815822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d546e52-e73b-46c5-9ba3-6c3a3f5eafa3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:29.889280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7d546e52-e73b-46c5-9ba3-6c3a3f5eafa3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:29.897644 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7d546e52-e73b-46c5-9ba3-6c3a3f5eafa3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.104691 Jul 04 06:13:29.898206 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 848/1688] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:30.832987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-36786aaf-9cfc-4041-a5b6-dddb312a6d91 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:30.833779 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-36786aaf-9cfc-4041-a5b6-dddb312a6d91 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:30.840941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36786aaf-9cfc-4041-a5b6-dddb312a6d91 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:30.841464 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36786aaf-9cfc-4041-a5b6-dddb312a6d91 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:30.842237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36786aaf-9cfc-4041-a5b6-dddb312a6d91 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:30.842680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36786aaf-9cfc-4041-a5b6-dddb312a6d91 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:30.915096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a3cca627-969d-4fe8-a6c9-4b4a04673f71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:30.915800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a3cca627-969d-4fe8-a6c9-4b4a04673f71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:30.922479 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3cca627-969d-4fe8-a6c9-4b4a04673f71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:30.922933 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3cca627-969d-4fe8-a6c9-4b4a04673f71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:30.923731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3cca627-969d-4fe8-a6c9-4b4a04673f71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:30.924169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3cca627-969d-4fe8-a6c9-4b4a04673f71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:30.971836 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-36786aaf-9cfc-4041-a5b6-dddb312a6d91 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:30.982595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-36786aaf-9cfc-4041-a5b6-dddb312a6d91 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.154516 Jul 04 06:13:30.982716 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 841/1689] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:30 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:30.984796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a3cca627-969d-4fe8-a6c9-4b4a04673f71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:30.993950 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a3cca627-969d-4fe8-a6c9-4b4a04673f71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.082770 Jul 04 06:13:30.994502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 849/1690] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:30 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:13:32.004609 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63037d91-2f49-4a92-b0ea-832e4bc0862c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:32.005550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63037d91-2f49-4a92-b0ea-832e4bc0862c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:32.011551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d80d8bf0-fe46-4a70-815d-7c49b06919e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:32.012161 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d80d8bf0-fe46-4a70-815d-7c49b06919e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:32.013180 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63037d91-2f49-4a92-b0ea-832e4bc0862c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:32.013640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63037d91-2f49-4a92-b0ea-832e4bc0862c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:32.014432 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63037d91-2f49-4a92-b0ea-832e4bc0862c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:32.014895 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63037d91-2f49-4a92-b0ea-832e4bc0862c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:32.018970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d80d8bf0-fe46-4a70-815d-7c49b06919e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:32.019459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d80d8bf0-fe46-4a70-815d-7c49b06919e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:32.020222 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d80d8bf0-fe46-4a70-815d-7c49b06919e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:32.020657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d80d8bf0-fe46-4a70-815d-7c49b06919e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:32.082234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d80d8bf0-fe46-4a70-815d-7c49b06919e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:32.090468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d80d8bf0-fe46-4a70-815d-7c49b06919e8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.082778 Jul 04 06:13:32.091024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 850/1691] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:32 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:13:32.146207 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-63037d91-2f49-4a92-b0ea-832e4bc0862c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:32.154790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63037d91-2f49-4a92-b0ea-832e4bc0862c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156726 Jul 04 06:13:32.155364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 842/1692] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:31 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:33.110679 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e83072b-ed96-4553-8628-0ccbd6684aa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:33.111621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e83072b-ed96-4553-8628-0ccbd6684aa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:33.119179 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e83072b-ed96-4553-8628-0ccbd6684aa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:33.119606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e83072b-ed96-4553-8628-0ccbd6684aa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:33.120376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e83072b-ed96-4553-8628-0ccbd6684aa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:33.120811 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e83072b-ed96-4553-8628-0ccbd6684aa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:33.177001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c532b47-75c6-4331-93fb-cb1ac9eec178 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:33.178224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9c532b47-75c6-4331-93fb-cb1ac9eec178 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:33.189567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c532b47-75c6-4331-93fb-cb1ac9eec178 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:33.190498 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c532b47-75c6-4331-93fb-cb1ac9eec178 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:33.191159 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c532b47-75c6-4331-93fb-cb1ac9eec178 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:33.191718 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c532b47-75c6-4331-93fb-cb1ac9eec178 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:33.192704 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e83072b-ed96-4553-8628-0ccbd6684aa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:33.201505 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e83072b-ed96-4553-8628-0ccbd6684aa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096785 Jul 04 06:13:33.202150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 851/1693] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:33.330569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9c532b47-75c6-4331-93fb-cb1ac9eec178 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:33.342436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9c532b47-75c6-4331-93fb-cb1ac9eec178 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.172613 Jul 04 06:13:33.343172 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 843/1694] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:33 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:34.223865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-abb724d7-c890-4fae-b934-51b82554eb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:34.224750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-abb724d7-c890-4fae-b934-51b82554eb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:34.231739 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abb724d7-c890-4fae-b934-51b82554eb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:34.232192 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abb724d7-c890-4fae-b934-51b82554eb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:34.232959 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abb724d7-c890-4fae-b934-51b82554eb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:34.233398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abb724d7-c890-4fae-b934-51b82554eb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:34.305896 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-abb724d7-c890-4fae-b934-51b82554eb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:34.314486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-abb724d7-c890-4fae-b934-51b82554eb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097916 Jul 04 06:13:34.315060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 852/1695] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:34.362105 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-20410ee1-7767-48a4-963a-6590c7e750d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:34.362667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-20410ee1-7767-48a4-963a-6590c7e750d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:34.365041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=54 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:13:34.370736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-20410ee1-7767-48a4-963a-6590c7e750d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:34.371151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-20410ee1-7767-48a4-963a-6590c7e750d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:34.371961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-20410ee1-7767-48a4-963a-6590c7e750d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:34.372460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-20410ee1-7767-48a4-963a-6590c7e750d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:34.512509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-20410ee1-7767-48a4-963a-6590c7e750d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:34.522168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-20410ee1-7767-48a4-963a-6590c7e750d4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163597 Jul 04 06:13:34.522865 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 844/1696] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:34 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:35.335541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-434cec8c-22bd-4e5a-9805-5ea2242c1d65 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:35.336253 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-434cec8c-22bd-4e5a-9805-5ea2242c1d65 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:35.344178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-434cec8c-22bd-4e5a-9805-5ea2242c1d65 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:35.344703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-434cec8c-22bd-4e5a-9805-5ea2242c1d65 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:35.345593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-434cec8c-22bd-4e5a-9805-5ea2242c1d65 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:35.346102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-434cec8c-22bd-4e5a-9805-5ea2242c1d65 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:35.420402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-434cec8c-22bd-4e5a-9805-5ea2242c1d65 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:35.428914 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-434cec8c-22bd-4e5a-9805-5ea2242c1d65 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.099869 Jul 04 06:13:35.429465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 853/1697] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:35.540211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9621fa33-75a2-4298-9299-4eb43a1a5a07 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:35.540854 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9621fa33-75a2-4298-9299-4eb43a1a5a07 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:35.548113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9621fa33-75a2-4298-9299-4eb43a1a5a07 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:35.548566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9621fa33-75a2-4298-9299-4eb43a1a5a07 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:35.549340 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9621fa33-75a2-4298-9299-4eb43a1a5a07 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:35.549780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9621fa33-75a2-4298-9299-4eb43a1a5a07 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:35.702083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9621fa33-75a2-4298-9299-4eb43a1a5a07 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:35.714857 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9621fa33-75a2-4298-9299-4eb43a1a5a07 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.178425 Jul 04 06:13:35.715644 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 845/1698] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:35 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:36.449845 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2bda95a8-c1b5-495f-b36e-36d745f51578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:36.450840 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2bda95a8-c1b5-495f-b36e-36d745f51578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:36.454517 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:13:36.463586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bda95a8-c1b5-495f-b36e-36d745f51578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:36.464349 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bda95a8-c1b5-495f-b36e-36d745f51578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:36.465618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bda95a8-c1b5-495f-b36e-36d745f51578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:36.466345 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bda95a8-c1b5-495f-b36e-36d745f51578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:36.532820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2bda95a8-c1b5-495f-b36e-36d745f51578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:36.542061 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2bda95a8-c1b5-495f-b36e-36d745f51578 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098884 Jul 04 06:13:36.542628 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 854/1699] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:36.740165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-70bf9e5d-b6a5-4431-8701-15c354b2e016 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:36.741200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-70bf9e5d-b6a5-4431-8701-15c354b2e016 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:36.748931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70bf9e5d-b6a5-4431-8701-15c354b2e016 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:36.749454 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70bf9e5d-b6a5-4431-8701-15c354b2e016 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:36.750274 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70bf9e5d-b6a5-4431-8701-15c354b2e016 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:36.750757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70bf9e5d-b6a5-4431-8701-15c354b2e016 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:36.888609 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-70bf9e5d-b6a5-4431-8701-15c354b2e016 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:36.897098 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-70bf9e5d-b6a5-4431-8701-15c354b2e016 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163764 Jul 04 06:13:36.897722 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 846/1700] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:36 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:37.560805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8d9473c3-1aac-4fe1-b7c3-908288fb8692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:37.561394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8d9473c3-1aac-4fe1-b7c3-908288fb8692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:37.568259 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d9473c3-1aac-4fe1-b7c3-908288fb8692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:37.568741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d9473c3-1aac-4fe1-b7c3-908288fb8692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:37.569657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d9473c3-1aac-4fe1-b7c3-908288fb8692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:37.570152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d9473c3-1aac-4fe1-b7c3-908288fb8692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:37.636407 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8d9473c3-1aac-4fe1-b7c3-908288fb8692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:37.645064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8d9473c3-1aac-4fe1-b7c3-908288fb8692 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089252 Jul 04 06:13:37.645619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 855/1701] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:37.917386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-16afbb64-dd51-42e0-a171-7ec08558ca19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:37.918066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-16afbb64-dd51-42e0-a171-7ec08558ca19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:37.926226 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16afbb64-dd51-42e0-a171-7ec08558ca19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:37.926757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16afbb64-dd51-42e0-a171-7ec08558ca19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:37.927721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16afbb64-dd51-42e0-a171-7ec08558ca19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:37.928234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16afbb64-dd51-42e0-a171-7ec08558ca19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:38.067917 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-16afbb64-dd51-42e0-a171-7ec08558ca19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:38.075990 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-16afbb64-dd51-42e0-a171-7ec08558ca19 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164152 Jul 04 06:13:38.076523 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 847/1702] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:37 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:38.665829 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c2670310-ddb8-4ff9-b0bc-7012e28390dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:38.666579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c2670310-ddb8-4ff9-b0bc-7012e28390dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:38.675583 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2670310-ddb8-4ff9-b0bc-7012e28390dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:38.676214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2670310-ddb8-4ff9-b0bc-7012e28390dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:38.677234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2670310-ddb8-4ff9-b0bc-7012e28390dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:38.677813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2670310-ddb8-4ff9-b0bc-7012e28390dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:38.753568 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c2670310-ddb8-4ff9-b0bc-7012e28390dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:38.762924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c2670310-ddb8-4ff9-b0bc-7012e28390dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.103451 Jul 04 06:13:38.763497 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 856/1703] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:39.097091 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-daa9b8a3-6f5b-4e51-8794-d4220657ffe4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:39.098021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-daa9b8a3-6f5b-4e51-8794-d4220657ffe4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:39.108974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-daa9b8a3-6f5b-4e51-8794-d4220657ffe4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:39.109729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-daa9b8a3-6f5b-4e51-8794-d4220657ffe4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:39.110996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-daa9b8a3-6f5b-4e51-8794-d4220657ffe4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:39.111807 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-daa9b8a3-6f5b-4e51-8794-d4220657ffe4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:39.248873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-daa9b8a3-6f5b-4e51-8794-d4220657ffe4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:39.257464 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-daa9b8a3-6f5b-4e51-8794-d4220657ffe4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167021 Jul 04 06:13:39.258028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 848/1704] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:39 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:39.784398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dfcb5115-bcf3-49e6-a132-f677181b6bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:39.785318 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dfcb5115-bcf3-49e6-a132-f677181b6bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:39.796184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfcb5115-bcf3-49e6-a132-f677181b6bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:39.796934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfcb5115-bcf3-49e6-a132-f677181b6bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:39.798283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfcb5115-bcf3-49e6-a132-f677181b6bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:39.799511 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfcb5115-bcf3-49e6-a132-f677181b6bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:39.865155 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dfcb5115-bcf3-49e6-a132-f677181b6bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:39.873375 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dfcb5115-bcf3-49e6-a132-f677181b6bef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096049 Jul 04 06:13:39.873941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 857/1705] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:40.279887 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d366ce6d-07f9-4f61-870f-71c76a5b08ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:40.280924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d366ce6d-07f9-4f61-870f-71c76a5b08ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:40.290663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d366ce6d-07f9-4f61-870f-71c76a5b08ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:40.291104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d366ce6d-07f9-4f61-870f-71c76a5b08ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:40.292018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d366ce6d-07f9-4f61-870f-71c76a5b08ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:40.292446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d366ce6d-07f9-4f61-870f-71c76a5b08ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:40.439557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d366ce6d-07f9-4f61-870f-71c76a5b08ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:40.448069 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d366ce6d-07f9-4f61-870f-71c76a5b08ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.175266 Jul 04 06:13:40.448670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 849/1706] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:40 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:40.893462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d3df965c-a611-4edb-8e45-25d97a5ac48e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:40.894370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d3df965c-a611-4edb-8e45-25d97a5ac48e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:40.904333 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3df965c-a611-4edb-8e45-25d97a5ac48e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:40.905045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3df965c-a611-4edb-8e45-25d97a5ac48e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:40.906211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3df965c-a611-4edb-8e45-25d97a5ac48e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:40.906778 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3df965c-a611-4edb-8e45-25d97a5ac48e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:40.972803 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d3df965c-a611-4edb-8e45-25d97a5ac48e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:40.980956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d3df965c-a611-4edb-8e45-25d97a5ac48e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092681 Jul 04 06:13:40.981515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 858/1707] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:41.468891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e76899d9-8127-4188-a5f0-ca59fc70f621 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:41.469931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e76899d9-8127-4188-a5f0-ca59fc70f621 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:41.480077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e76899d9-8127-4188-a5f0-ca59fc70f621 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:41.480530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e76899d9-8127-4188-a5f0-ca59fc70f621 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:41.481294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e76899d9-8127-4188-a5f0-ca59fc70f621 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:41.481759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e76899d9-8127-4188-a5f0-ca59fc70f621 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:41.611793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e76899d9-8127-4188-a5f0-ca59fc70f621 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:41.623996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e76899d9-8127-4188-a5f0-ca59fc70f621 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.161308 Jul 04 06:13:41.624868 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 850/1708] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:41 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:42.002278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ef91995-f181-4c25-844e-a0b295dfb17d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:42.003161 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8ef91995-f181-4c25-844e-a0b295dfb17d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:42.014486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef91995-f181-4c25-844e-a0b295dfb17d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:42.015220 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef91995-f181-4c25-844e-a0b295dfb17d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:42.016552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef91995-f181-4c25-844e-a0b295dfb17d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:42.017274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ef91995-f181-4c25-844e-a0b295dfb17d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:42.095892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ef91995-f181-4c25-844e-a0b295dfb17d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:42.107329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ef91995-f181-4c25-844e-a0b295dfb17d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.111912 Jul 04 06:13:42.108063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 859/1709] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:41 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:42.649257 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-94df1083-d257-4c08-9c9c-db23733a666c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:42.650263 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-94df1083-d257-4c08-9c9c-db23733a666c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:42.657792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94df1083-d257-4c08-9c9c-db23733a666c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:42.658245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94df1083-d257-4c08-9c9c-db23733a666c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:42.659044 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94df1083-d257-4c08-9c9c-db23733a666c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:42.659533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94df1083-d257-4c08-9c9c-db23733a666c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:42.794100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-94df1083-d257-4c08-9c9c-db23733a666c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:42.802399 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-94df1083-d257-4c08-9c9c-db23733a666c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159699 Jul 04 06:13:42.802968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 851/1710] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:42 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:43.128524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d1ea1d04-05c7-4554-99b9-79980aa8e682 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:43.129114 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d1ea1d04-05c7-4554-99b9-79980aa8e682 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:43.135870 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1ea1d04-05c7-4554-99b9-79980aa8e682 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:43.136309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1ea1d04-05c7-4554-99b9-79980aa8e682 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:43.137063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1ea1d04-05c7-4554-99b9-79980aa8e682 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:43.137678 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1ea1d04-05c7-4554-99b9-79980aa8e682 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:43.140235 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:13:43.205535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d1ea1d04-05c7-4554-99b9-79980aa8e682 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:43.214010 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d1ea1d04-05c7-4554-99b9-79980aa8e682 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089458 Jul 04 06:13:43.214578 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 860/1711] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:43.824759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-65d079f6-9300-46ff-bca2-4e35e397307e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:43.825680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-65d079f6-9300-46ff-bca2-4e35e397307e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:43.836777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65d079f6-9300-46ff-bca2-4e35e397307e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:43.837537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65d079f6-9300-46ff-bca2-4e35e397307e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:43.838586 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65d079f6-9300-46ff-bca2-4e35e397307e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:43.839024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65d079f6-9300-46ff-bca2-4e35e397307e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:43.972956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-65d079f6-9300-46ff-bca2-4e35e397307e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:43.982584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-65d079f6-9300-46ff-bca2-4e35e397307e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164863 Jul 04 06:13:43.983147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 852/1712] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:43 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:44.233032 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-10706b09-cf9b-4ab0-938e-a14a055f2efe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:44.233723 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-10706b09-cf9b-4ab0-938e-a14a055f2efe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:44.241772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10706b09-cf9b-4ab0-938e-a14a055f2efe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:44.242305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10706b09-cf9b-4ab0-938e-a14a055f2efe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:44.243206 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10706b09-cf9b-4ab0-938e-a14a055f2efe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:44.243758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10706b09-cf9b-4ab0-938e-a14a055f2efe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:44.306599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10706b09-cf9b-4ab0-938e-a14a055f2efe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:44.314843 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-10706b09-cf9b-4ab0-938e-a14a055f2efe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087241 Jul 04 06:13:44.315427 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 861/1713] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:44 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:45.004230 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1376cc22-8fc7-493b-ad99-cb43bdfbde44 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:45.005161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1376cc22-8fc7-493b-ad99-cb43bdfbde44 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:45.014215 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1376cc22-8fc7-493b-ad99-cb43bdfbde44 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:45.014661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1376cc22-8fc7-493b-ad99-cb43bdfbde44 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:45.015462 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1376cc22-8fc7-493b-ad99-cb43bdfbde44 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:45.015895 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1376cc22-8fc7-493b-ad99-cb43bdfbde44 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:45.156101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1376cc22-8fc7-493b-ad99-cb43bdfbde44 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:45.168809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1376cc22-8fc7-493b-ad99-cb43bdfbde44 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.171117 Jul 04 06:13:45.169452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 853/1714] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:44 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:45.334856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ce552110-1f60-4c9b-bafb-1291301171ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:45.336915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ce552110-1f60-4c9b-bafb-1291301171ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:45.344763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce552110-1f60-4c9b-bafb-1291301171ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:45.345209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce552110-1f60-4c9b-bafb-1291301171ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:45.345970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce552110-1f60-4c9b-bafb-1291301171ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:45.346399 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ce552110-1f60-4c9b-bafb-1291301171ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:45.408518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ce552110-1f60-4c9b-bafb-1291301171ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:45.416802 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ce552110-1f60-4c9b-bafb-1291301171ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088321 Jul 04 06:13:45.417253 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 862/1715] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:46.190175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-abd20daa-57ae-43e6-9784-ca18eb2b65c7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:46.191152 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-abd20daa-57ae-43e6-9784-ca18eb2b65c7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:46.202404 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abd20daa-57ae-43e6-9784-ca18eb2b65c7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:46.203215 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abd20daa-57ae-43e6-9784-ca18eb2b65c7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:46.204544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abd20daa-57ae-43e6-9784-ca18eb2b65c7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:46.205275 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abd20daa-57ae-43e6-9784-ca18eb2b65c7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:46.342191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-abd20daa-57ae-43e6-9784-ca18eb2b65c7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:46.354339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-abd20daa-57ae-43e6-9784-ca18eb2b65c7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170307 Jul 04 06:13:46.354921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 854/1716] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:46 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:46.437618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-21afcac6-45d9-494d-b79d-781bd25aedcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:46.438618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-21afcac6-45d9-494d-b79d-781bd25aedcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:46.449170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21afcac6-45d9-494d-b79d-781bd25aedcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:46.449559 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21afcac6-45d9-494d-b79d-781bd25aedcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:46.450326 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21afcac6-45d9-494d-b79d-781bd25aedcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:46.450766 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21afcac6-45d9-494d-b79d-781bd25aedcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:46.512759 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-21afcac6-45d9-494d-b79d-781bd25aedcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:46.521196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-21afcac6-45d9-494d-b79d-781bd25aedcd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090274 Jul 04 06:13:46.521776 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 863/1717] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:46 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:47.376212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dc567f8f-faff-48fd-9c42-8e860be77b7f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:47.377162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dc567f8f-faff-48fd-9c42-8e860be77b7f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:47.387646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc567f8f-faff-48fd-9c42-8e860be77b7f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:47.388088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc567f8f-faff-48fd-9c42-8e860be77b7f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:47.388849 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc567f8f-faff-48fd-9c42-8e860be77b7f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:47.389276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc567f8f-faff-48fd-9c42-8e860be77b7f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:47.391817 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:13:47.524619 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dc567f8f-faff-48fd-9c42-8e860be77b7f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:47.533309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dc567f8f-faff-48fd-9c42-8e860be77b7f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163928 Jul 04 06:13:47.533862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 855/1718] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:47 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:47.537956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-58745cb2-2f8a-4f54-9c78-fb75bab538f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:47.539209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-58745cb2-2f8a-4f54-9c78-fb75bab538f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:47.546707 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58745cb2-2f8a-4f54-9c78-fb75bab538f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:47.547189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58745cb2-2f8a-4f54-9c78-fb75bab538f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:47.547967 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58745cb2-2f8a-4f54-9c78-fb75bab538f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:47.548403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58745cb2-2f8a-4f54-9c78-fb75bab538f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:47.613471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-58745cb2-2f8a-4f54-9c78-fb75bab538f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:47.621889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-58745cb2-2f8a-4f54-9c78-fb75bab538f8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087811 Jul 04 06:13:47.622476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 864/1719] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:48.551021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42af96c1-f6c2-4e03-be91-c6b25d84f66f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:48.551651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-42af96c1-f6c2-4e03-be91-c6b25d84f66f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:48.558602 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42af96c1-f6c2-4e03-be91-c6b25d84f66f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:48.559052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42af96c1-f6c2-4e03-be91-c6b25d84f66f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:48.559852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42af96c1-f6c2-4e03-be91-c6b25d84f66f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:48.560284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42af96c1-f6c2-4e03-be91-c6b25d84f66f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:48.638111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-59ddb926-7fdd-4608-b878-2529f830886e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:48.638751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-59ddb926-7fdd-4608-b878-2529f830886e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:48.645843 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59ddb926-7fdd-4608-b878-2529f830886e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:48.646299 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59ddb926-7fdd-4608-b878-2529f830886e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:48.647069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59ddb926-7fdd-4608-b878-2529f830886e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:48.647546 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59ddb926-7fdd-4608-b878-2529f830886e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:48.694198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-42af96c1-f6c2-4e03-be91-c6b25d84f66f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:48.702388 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-42af96c1-f6c2-4e03-be91-c6b25d84f66f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.155362 Jul 04 06:13:48.702926 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 856/1720] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:48 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:48.711581 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-59ddb926-7fdd-4608-b878-2529f830886e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:48.719859 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-59ddb926-7fdd-4608-b878-2529f830886e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085713 Jul 04 06:13:48.720416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 865/1721] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:13:49.723219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-27394a82-58e1-4ea2-86f8-46f30d99c8ee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:49.724217 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-27394a82-58e1-4ea2-86f8-46f30d99c8ee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:49.735468 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27394a82-58e1-4ea2-86f8-46f30d99c8ee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:49.736216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27394a82-58e1-4ea2-86f8-46f30d99c8ee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:49.737467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27394a82-58e1-4ea2-86f8-46f30d99c8ee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:49.738158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27394a82-58e1-4ea2-86f8-46f30d99c8ee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:49.740494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b9d33492-161f-4b18-bd61-ed2de1082c5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:49.741456 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b9d33492-161f-4b18-bd61-ed2de1082c5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:49.750053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9d33492-161f-4b18-bd61-ed2de1082c5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:49.750564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9d33492-161f-4b18-bd61-ed2de1082c5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:49.751360 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9d33492-161f-4b18-bd61-ed2de1082c5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:49.751790 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9d33492-161f-4b18-bd61-ed2de1082c5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:49.821883 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b9d33492-161f-4b18-bd61-ed2de1082c5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:49.830603 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b9d33492-161f-4b18-bd61-ed2de1082c5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096735 Jul 04 06:13:49.831181 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 866/1722] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:49.881420 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-27394a82-58e1-4ea2-86f8-46f30d99c8ee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:49.893587 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-27394a82-58e1-4ea2-86f8-46f30d99c8ee tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.176540 Jul 04 06:13:49.894166 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 857/1723] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:49 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:50.851696 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-347d29b6-d9f0-4983-9b10-446696a77f55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:50.852555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-347d29b6-d9f0-4983-9b10-446696a77f55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:50.863624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-347d29b6-d9f0-4983-9b10-446696a77f55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:50.864379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-347d29b6-d9f0-4983-9b10-446696a77f55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:50.865637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-347d29b6-d9f0-4983-9b10-446696a77f55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:50.866417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-347d29b6-d9f0-4983-9b10-446696a77f55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:50.911224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-483aeaf9-51cf-4fda-bc89-144c2edff049 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:50.911852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-483aeaf9-51cf-4fda-bc89-144c2edff049 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:50.918494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-483aeaf9-51cf-4fda-bc89-144c2edff049 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:50.918992 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-483aeaf9-51cf-4fda-bc89-144c2edff049 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:50.919752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-483aeaf9-51cf-4fda-bc89-144c2edff049 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:50.920187 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-483aeaf9-51cf-4fda-bc89-144c2edff049 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:50.930524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-347d29b6-d9f0-4983-9b10-446696a77f55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:50.938819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-347d29b6-d9f0-4983-9b10-446696a77f55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093930 Jul 04 06:13:50.939410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 867/1724] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:50 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:51.057606 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-483aeaf9-51cf-4fda-bc89-144c2edff049 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:51.065797 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-483aeaf9-51cf-4fda-bc89-144c2edff049 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158482 Jul 04 06:13:51.066364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 858/1725] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:50 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:51.960302 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a28fbafc-95e7-4dac-a158-285b6fb0292d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:51.961221 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a28fbafc-95e7-4dac-a158-285b6fb0292d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:51.972562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a28fbafc-95e7-4dac-a158-285b6fb0292d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:51.973354 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a28fbafc-95e7-4dac-a158-285b6fb0292d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:51.974642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a28fbafc-95e7-4dac-a158-285b6fb0292d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:51.975391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a28fbafc-95e7-4dac-a158-285b6fb0292d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:52.041770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a28fbafc-95e7-4dac-a158-285b6fb0292d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:52.050242 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a28fbafc-95e7-4dac-a158-285b6fb0292d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096575 Jul 04 06:13:52.050787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 868/1726] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:51 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:52.087859 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fc8c9481-ce86-4e4e-9c17-c42f1a701e43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:52.088435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fc8c9481-ce86-4e4e-9c17-c42f1a701e43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:52.095197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc8c9481-ce86-4e4e-9c17-c42f1a701e43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:52.095680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc8c9481-ce86-4e4e-9c17-c42f1a701e43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:52.096455 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc8c9481-ce86-4e4e-9c17-c42f1a701e43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:52.096915 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc8c9481-ce86-4e4e-9c17-c42f1a701e43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:52.234830 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fc8c9481-ce86-4e4e-9c17-c42f1a701e43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:52.247690 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fc8c9481-ce86-4e4e-9c17-c42f1a701e43 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163406 Jul 04 06:13:52.248479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 859/1727] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:52 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:53.079032 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7f90acc3-e2f6-4042-8f93-5c222cae9646 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:53.080132 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7f90acc3-e2f6-4042-8f93-5c222cae9646 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:53.090510 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f90acc3-e2f6-4042-8f93-5c222cae9646 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:53.090966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f90acc3-e2f6-4042-8f93-5c222cae9646 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:53.091774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f90acc3-e2f6-4042-8f93-5c222cae9646 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:53.092208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f90acc3-e2f6-4042-8f93-5c222cae9646 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:53.154958 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7f90acc3-e2f6-4042-8f93-5c222cae9646 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:53.163217 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7f90acc3-e2f6-4042-8f93-5c222cae9646 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090714 Jul 04 06:13:53.163813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 869/1728] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:53 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:53.274035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-217d8285-94d0-40e4-8501-62259384d623 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:53.275092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-217d8285-94d0-40e4-8501-62259384d623 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:53.283158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-217d8285-94d0-40e4-8501-62259384d623 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:53.283646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-217d8285-94d0-40e4-8501-62259384d623 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:53.284415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-217d8285-94d0-40e4-8501-62259384d623 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:53.284847 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-217d8285-94d0-40e4-8501-62259384d623 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:53.428763 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-217d8285-94d0-40e4-8501-62259384d623 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:53.437325 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-217d8285-94d0-40e4-8501-62259384d623 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169849 Jul 04 06:13:53.437894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 860/1729] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:53 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:54.181592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f8a41e70-e334-4dc6-aaac-7bffa5385411 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:54.182242 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f8a41e70-e334-4dc6-aaac-7bffa5385411 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:54.189394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8a41e70-e334-4dc6-aaac-7bffa5385411 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:54.189846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8a41e70-e334-4dc6-aaac-7bffa5385411 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:54.190619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8a41e70-e334-4dc6-aaac-7bffa5385411 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:54.191060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8a41e70-e334-4dc6-aaac-7bffa5385411 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:54.254189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f8a41e70-e334-4dc6-aaac-7bffa5385411 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:54.262893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f8a41e70-e334-4dc6-aaac-7bffa5385411 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085567 Jul 04 06:13:54.263490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 870/1730] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:54.456539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4a86d9a3-69e8-49bf-97c3-bacd3e54652b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:54.457186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4a86d9a3-69e8-49bf-97c3-bacd3e54652b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:54.464559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a86d9a3-69e8-49bf-97c3-bacd3e54652b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:54.465094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a86d9a3-69e8-49bf-97c3-bacd3e54652b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:54.466219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a86d9a3-69e8-49bf-97c3-bacd3e54652b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:54.466739 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a86d9a3-69e8-49bf-97c3-bacd3e54652b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:54.601697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4a86d9a3-69e8-49bf-97c3-bacd3e54652b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:54.610456 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4a86d9a3-69e8-49bf-97c3-bacd3e54652b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158109 Jul 04 06:13:54.611033 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 861/1731] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:54 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:55.284066 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eeb937d8-ee80-422b-89b4-016b9733da6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:55.285064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eeb937d8-ee80-422b-89b4-016b9733da6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:55.295082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eeb937d8-ee80-422b-89b4-016b9733da6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:55.295569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eeb937d8-ee80-422b-89b4-016b9733da6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:55.296359 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eeb937d8-ee80-422b-89b4-016b9733da6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:55.296821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eeb937d8-ee80-422b-89b4-016b9733da6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:55.359450 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eeb937d8-ee80-422b-89b4-016b9733da6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:55.367926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eeb937d8-ee80-422b-89b4-016b9733da6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090828 Jul 04 06:13:55.368507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 871/1732] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:55.632206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-081f6d28-8099-4bef-a602-373d5c5dbe67 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:55.633052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-081f6d28-8099-4bef-a602-373d5c5dbe67 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:55.644387 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-081f6d28-8099-4bef-a602-373d5c5dbe67 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:55.645114 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-081f6d28-8099-4bef-a602-373d5c5dbe67 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:55.646358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-081f6d28-8099-4bef-a602-373d5c5dbe67 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:55.647068 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-081f6d28-8099-4bef-a602-373d5c5dbe67 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:55.790447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-081f6d28-8099-4bef-a602-373d5c5dbe67 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:55.800354 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-081f6d28-8099-4bef-a602-373d5c5dbe67 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.174745 Jul 04 06:13:55.800930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 862/1733] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:55 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:56.388601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fd1eac4d-d3d4-4ccf-bfa0-2dd0a2656892 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:56.389653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fd1eac4d-d3d4-4ccf-bfa0-2dd0a2656892 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:56.400906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd1eac4d-d3d4-4ccf-bfa0-2dd0a2656892 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:56.401561 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd1eac4d-d3d4-4ccf-bfa0-2dd0a2656892 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:56.402810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd1eac4d-d3d4-4ccf-bfa0-2dd0a2656892 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:56.403901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd1eac4d-d3d4-4ccf-bfa0-2dd0a2656892 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:56.476186 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fd1eac4d-d3d4-4ccf-bfa0-2dd0a2656892 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:56.486266 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fd1eac4d-d3d4-4ccf-bfa0-2dd0a2656892 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.104342 Jul 04 06:13:56.486831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 872/1734] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:56 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:56.818047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-901de507-55e5-43af-b480-8ce2767442ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:56.818619 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-901de507-55e5-43af-b480-8ce2767442ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:56.825659 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-901de507-55e5-43af-b480-8ce2767442ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:56.826103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-901de507-55e5-43af-b480-8ce2767442ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:56.826852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-901de507-55e5-43af-b480-8ce2767442ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:56.827293 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-901de507-55e5-43af-b480-8ce2767442ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:56.962470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-901de507-55e5-43af-b480-8ce2767442ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:56.971472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-901de507-55e5-43af-b480-8ce2767442ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.157361 Jul 04 06:13:56.972070 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 863/1735] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:56 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:57.513316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a76f427f-bf0d-46eb-8916-f5fd28e0ab47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:57.513954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a76f427f-bf0d-46eb-8916-f5fd28e0ab47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:57.521924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a76f427f-bf0d-46eb-8916-f5fd28e0ab47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:57.522352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a76f427f-bf0d-46eb-8916-f5fd28e0ab47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:57.523152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a76f427f-bf0d-46eb-8916-f5fd28e0ab47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:57.523618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a76f427f-bf0d-46eb-8916-f5fd28e0ab47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:57.589921 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a76f427f-bf0d-46eb-8916-f5fd28e0ab47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:57.598418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a76f427f-bf0d-46eb-8916-f5fd28e0ab47 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092768 Jul 04 06:13:57.599026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 873/1736] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:57 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:57.993245 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2d4f5c14-0da0-47ea-ba4f-f9efa36e8e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:57.994185 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2d4f5c14-0da0-47ea-ba4f-f9efa36e8e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:58.004749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d4f5c14-0da0-47ea-ba4f-f9efa36e8e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:58.006171 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d4f5c14-0da0-47ea-ba4f-f9efa36e8e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:58.007743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d4f5c14-0da0-47ea-ba4f-f9efa36e8e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:58.008627 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d4f5c14-0da0-47ea-ba4f-f9efa36e8e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:58.144924 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2d4f5c14-0da0-47ea-ba4f-f9efa36e8e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:58.157877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2d4f5c14-0da0-47ea-ba4f-f9efa36e8e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170902 Jul 04 06:13:58.158682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 864/1737] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:57 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:58.616087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2caec5ef-58ed-4099-8553-94599a2c28b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:58.617175 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2caec5ef-58ed-4099-8553-94599a2c28b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:58.624553 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2caec5ef-58ed-4099-8553-94599a2c28b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:58.625004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2caec5ef-58ed-4099-8553-94599a2c28b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:58.625766 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2caec5ef-58ed-4099-8553-94599a2c28b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:58.626239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2caec5ef-58ed-4099-8553-94599a2c28b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:58.688003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2caec5ef-58ed-4099-8553-94599a2c28b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:58.696519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2caec5ef-58ed-4099-8553-94599a2c28b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.084582 Jul 04 06:13:58.697093 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 874/1738] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:59.179711 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5602b244-2dcc-4cb3-8d3a-2047e2339df6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:59.180781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5602b244-2dcc-4cb3-8d3a-2047e2339df6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:59.189759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5602b244-2dcc-4cb3-8d3a-2047e2339df6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:59.190216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5602b244-2dcc-4cb3-8d3a-2047e2339df6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:59.190983 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5602b244-2dcc-4cb3-8d3a-2047e2339df6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:59.191460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5602b244-2dcc-4cb3-8d3a-2047e2339df6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:59.322529 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5602b244-2dcc-4cb3-8d3a-2047e2339df6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:59.336002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5602b244-2dcc-4cb3-8d3a-2047e2339df6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162809 Jul 04 06:13:59.337569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 865/1739] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:59 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:13:59.717022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e96bb1a7-9bc8-4009-8fd3-2f8d3d371912 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:13:59.718037 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e96bb1a7-9bc8-4009-8fd3-2f8d3d371912 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:13:59.729411 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e96bb1a7-9bc8-4009-8fd3-2f8d3d371912 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:59.730165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e96bb1a7-9bc8-4009-8fd3-2f8d3d371912 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:59.731496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e96bb1a7-9bc8-4009-8fd3-2f8d3d371912 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:13:59.732218 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e96bb1a7-9bc8-4009-8fd3-2f8d3d371912 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:13:59.817638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e96bb1a7-9bc8-4009-8fd3-2f8d3d371912 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:13:59.831095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e96bb1a7-9bc8-4009-8fd3-2f8d3d371912 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.120707 Jul 04 06:13:59.831693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 875/1740] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:13:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:00.354330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c75d154a-6efb-48b6-b081-e4a21423e16d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:00.354954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c75d154a-6efb-48b6-b081-e4a21423e16d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:00.362709 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c75d154a-6efb-48b6-b081-e4a21423e16d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:00.363155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c75d154a-6efb-48b6-b081-e4a21423e16d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:00.364039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c75d154a-6efb-48b6-b081-e4a21423e16d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:00.364462 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c75d154a-6efb-48b6-b081-e4a21423e16d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:00.527720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c75d154a-6efb-48b6-b081-e4a21423e16d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:00.538774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c75d154a-6efb-48b6-b081-e4a21423e16d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.189322 Jul 04 06:14:00.539370 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 866/1741] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:00 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:00.854437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a724dfcd-a8e9-4757-9788-8aa86d218c49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:00.855358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a724dfcd-a8e9-4757-9788-8aa86d218c49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:00.866446 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a724dfcd-a8e9-4757-9788-8aa86d218c49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:00.867192 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a724dfcd-a8e9-4757-9788-8aa86d218c49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:00.868524 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a724dfcd-a8e9-4757-9788-8aa86d218c49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:00.869256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a724dfcd-a8e9-4757-9788-8aa86d218c49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:00.942089 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a724dfcd-a8e9-4757-9788-8aa86d218c49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:00.945540 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:14:00.955296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a724dfcd-a8e9-4757-9788-8aa86d218c49 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.107623 Jul 04 06:14:00.955844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 876/1742] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:00 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:01.556557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8b4b7887-9d4a-4f76-8461-489a880f3ea8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:01.557146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8b4b7887-9d4a-4f76-8461-489a880f3ea8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:01.564264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b4b7887-9d4a-4f76-8461-489a880f3ea8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:01.564714 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b4b7887-9d4a-4f76-8461-489a880f3ea8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:01.565476 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b4b7887-9d4a-4f76-8461-489a880f3ea8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:01.565910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b4b7887-9d4a-4f76-8461-489a880f3ea8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:01.697084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8b4b7887-9d4a-4f76-8461-489a880f3ea8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:01.705661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8b4b7887-9d4a-4f76-8461-489a880f3ea8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.153090 Jul 04 06:14:01.706307 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 867/1743] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:01 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:01.976367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-569abc4e-dc26-452b-bb3d-9f9f9d0350f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:01.977327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-569abc4e-dc26-452b-bb3d-9f9f9d0350f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:01.986923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-569abc4e-dc26-452b-bb3d-9f9f9d0350f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:01.987409 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-569abc4e-dc26-452b-bb3d-9f9f9d0350f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:01.988170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-569abc4e-dc26-452b-bb3d-9f9f9d0350f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:01.988595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-569abc4e-dc26-452b-bb3d-9f9f9d0350f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:02.054020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-569abc4e-dc26-452b-bb3d-9f9f9d0350f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:02.062019 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-569abc4e-dc26-452b-bb3d-9f9f9d0350f6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092185 Jul 04 06:14:02.062605 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 877/1744] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:01 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:02.732747 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d41c3314-7001-4476-8771-8de3d54be213 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:02.733872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d41c3314-7001-4476-8771-8de3d54be213 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:02.740887 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d41c3314-7001-4476-8771-8de3d54be213 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:02.741334 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d41c3314-7001-4476-8771-8de3d54be213 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:02.742087 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d41c3314-7001-4476-8771-8de3d54be213 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:02.742514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d41c3314-7001-4476-8771-8de3d54be213 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:02.884411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d41c3314-7001-4476-8771-8de3d54be213 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:02.896305 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d41c3314-7001-4476-8771-8de3d54be213 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170036 Jul 04 06:14:02.897097 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 868/1745] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:02 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:03.082007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3cd7091-128a-4891-ae3d-8c6fad6fd03f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:03.083004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e3cd7091-128a-4891-ae3d-8c6fad6fd03f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:03.093650 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3cd7091-128a-4891-ae3d-8c6fad6fd03f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:03.094109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3cd7091-128a-4891-ae3d-8c6fad6fd03f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:03.094880 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3cd7091-128a-4891-ae3d-8c6fad6fd03f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:03.095339 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3cd7091-128a-4891-ae3d-8c6fad6fd03f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:03.162730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e3cd7091-128a-4891-ae3d-8c6fad6fd03f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:03.171341 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e3cd7091-128a-4891-ae3d-8c6fad6fd03f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095523 Jul 04 06:14:03.171917 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 878/1746] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:03.922017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bbcf174d-f3f4-4d92-9f0b-9ff158bd52c5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:03.922720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bbcf174d-f3f4-4d92-9f0b-9ff158bd52c5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:03.931145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbcf174d-f3f4-4d92-9f0b-9ff158bd52c5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:03.931743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbcf174d-f3f4-4d92-9f0b-9ff158bd52c5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:03.932690 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbcf174d-f3f4-4d92-9f0b-9ff158bd52c5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:03.933233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbcf174d-f3f4-4d92-9f0b-9ff158bd52c5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:04.078673 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bbcf174d-f3f4-4d92-9f0b-9ff158bd52c5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:04.086726 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bbcf174d-f3f4-4d92-9f0b-9ff158bd52c5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.171318 Jul 04 06:14:04.087297 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 869/1747] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:03 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:04.192521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-44fa7a75-70bf-4e04-8479-67391e06a125 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:04.193376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-44fa7a75-70bf-4e04-8479-67391e06a125 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:04.203833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44fa7a75-70bf-4e04-8479-67391e06a125 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:04.204274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44fa7a75-70bf-4e04-8479-67391e06a125 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:04.205030 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44fa7a75-70bf-4e04-8479-67391e06a125 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:04.205457 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44fa7a75-70bf-4e04-8479-67391e06a125 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:04.268511 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-44fa7a75-70bf-4e04-8479-67391e06a125 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:04.276869 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-44fa7a75-70bf-4e04-8479-67391e06a125 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091279 Jul 04 06:14:04.277440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 879/1748] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:05.108442 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e85588b0-6259-47fc-b29d-d2abaf8328a0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:05.109398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e85588b0-6259-47fc-b29d-d2abaf8328a0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:05.113132 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:14:05.122177 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e85588b0-6259-47fc-b29d-d2abaf8328a0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:05.122917 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e85588b0-6259-47fc-b29d-d2abaf8328a0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:05.124265 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e85588b0-6259-47fc-b29d-d2abaf8328a0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:05.124835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e85588b0-6259-47fc-b29d-d2abaf8328a0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:05.256529 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e85588b0-6259-47fc-b29d-d2abaf8328a0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:05.264670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e85588b0-6259-47fc-b29d-d2abaf8328a0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162778 Jul 04 06:14:05.265249 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 870/1749] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:05 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:05.294211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fbcbb485-8dcd-485a-bb7e-0b921d2975bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:05.294842 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fbcbb485-8dcd-485a-bb7e-0b921d2975bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:05.301834 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbcbb485-8dcd-485a-bb7e-0b921d2975bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:05.302282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbcbb485-8dcd-485a-bb7e-0b921d2975bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:05.303036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbcbb485-8dcd-485a-bb7e-0b921d2975bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:05.303500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbcbb485-8dcd-485a-bb7e-0b921d2975bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:05.374458 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fbcbb485-8dcd-485a-bb7e-0b921d2975bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:05.387166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fbcbb485-8dcd-485a-bb7e-0b921d2975bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096660 Jul 04 06:14:05.388107 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 880/1750] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:05 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:06.285977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ebcc166-0fd7-4062-b474-116ede3eea86 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:06.287084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1ebcc166-0fd7-4062-b474-116ede3eea86 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:06.297392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ebcc166-0fd7-4062-b474-116ede3eea86 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:06.297841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ebcc166-0fd7-4062-b474-116ede3eea86 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:06.298941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ebcc166-0fd7-4062-b474-116ede3eea86 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:06.299413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ebcc166-0fd7-4062-b474-116ede3eea86 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:06.405397 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c3a1b908-0650-49bf-a1e5-739b9f6ead70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:06.406178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c3a1b908-0650-49bf-a1e5-739b9f6ead70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:06.412973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3a1b908-0650-49bf-a1e5-739b9f6ead70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:06.413408 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3a1b908-0650-49bf-a1e5-739b9f6ead70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:06.414201 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3a1b908-0650-49bf-a1e5-739b9f6ead70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:06.414642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3a1b908-0650-49bf-a1e5-739b9f6ead70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:06.435697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ebcc166-0fd7-4062-b474-116ede3eea86 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:06.437903 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:14:06.444588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ebcc166-0fd7-4062-b474-116ede3eea86 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165258 Jul 04 06:14:06.445159 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 871/1751] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:06 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:06.477178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c3a1b908-0650-49bf-a1e5-739b9f6ead70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:06.485316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c3a1b908-0650-49bf-a1e5-739b9f6ead70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.084212 Jul 04 06:14:06.485917 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 881/1752] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:07.466455 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab0c02b4-4794-4c87-80fc-10ee991f52b0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:07.467472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab0c02b4-4794-4c87-80fc-10ee991f52b0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:07.474982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab0c02b4-4794-4c87-80fc-10ee991f52b0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:07.475441 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab0c02b4-4794-4c87-80fc-10ee991f52b0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:07.476207 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab0c02b4-4794-4c87-80fc-10ee991f52b0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:07.476641 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab0c02b4-4794-4c87-80fc-10ee991f52b0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:07.502069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8c63c91c-7eca-4acd-9a2c-e35f92b87bc4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:07.502824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8c63c91c-7eca-4acd-9a2c-e35f92b87bc4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:07.505352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:14:07.510988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c63c91c-7eca-4acd-9a2c-e35f92b87bc4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:07.511467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c63c91c-7eca-4acd-9a2c-e35f92b87bc4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:07.512249 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c63c91c-7eca-4acd-9a2c-e35f92b87bc4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:07.512684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c63c91c-7eca-4acd-9a2c-e35f92b87bc4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:07.578621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c63c91c-7eca-4acd-9a2c-e35f92b87bc4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:07.587791 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8c63c91c-7eca-4acd-9a2c-e35f92b87bc4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089612 Jul 04 06:14:07.588373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 882/1753] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:07.610234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab0c02b4-4794-4c87-80fc-10ee991f52b0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:07.618524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab0c02b4-4794-4c87-80fc-10ee991f52b0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159139 Jul 04 06:14:07.619088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 872/1754] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:07 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:08.606355 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-12671b23-83dc-4513-b4f5-2ae3e69939eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:08.607116 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-12671b23-83dc-4513-b4f5-2ae3e69939eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:08.615880 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12671b23-83dc-4513-b4f5-2ae3e69939eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:08.616430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12671b23-83dc-4513-b4f5-2ae3e69939eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:08.617394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12671b23-83dc-4513-b4f5-2ae3e69939eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:08.617939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12671b23-83dc-4513-b4f5-2ae3e69939eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:08.635683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2418c90-5b44-4888-8add-c268e720425a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:08.636240 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c2418c90-5b44-4888-8add-c268e720425a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:08.643568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2418c90-5b44-4888-8add-c268e720425a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:08.644018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2418c90-5b44-4888-8add-c268e720425a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:08.644788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2418c90-5b44-4888-8add-c268e720425a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:08.645219 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2418c90-5b44-4888-8add-c268e720425a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:08.681635 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-12671b23-83dc-4513-b4f5-2ae3e69939eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:08.690163 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-12671b23-83dc-4513-b4f5-2ae3e69939eb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088637 Jul 04 06:14:08.690753 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 883/1755] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:08 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:08.789068 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c2418c90-5b44-4888-8add-c268e720425a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:08.797125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2418c90-5b44-4888-8add-c268e720425a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165462 Jul 04 06:14:08.797692 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 873/1756] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:08 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:09.711169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cf995332-29c5-45ed-8356-084e85ad5dc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:09.712339 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cf995332-29c5-45ed-8356-084e85ad5dc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:09.723501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf995332-29c5-45ed-8356-084e85ad5dc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:09.724252 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf995332-29c5-45ed-8356-084e85ad5dc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:09.725530 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf995332-29c5-45ed-8356-084e85ad5dc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:09.726246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf995332-29c5-45ed-8356-084e85ad5dc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:09.796447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cf995332-29c5-45ed-8356-084e85ad5dc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:09.805781 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cf995332-29c5-45ed-8356-084e85ad5dc9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.101430 Jul 04 06:14:09.806365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 884/1757] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:09.814212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6958fa2d-5739-4e67-a0ed-c677cddc91ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:09.814803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6958fa2d-5739-4e67-a0ed-c677cddc91ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:09.821981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6958fa2d-5739-4e67-a0ed-c677cddc91ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:09.822431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6958fa2d-5739-4e67-a0ed-c677cddc91ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:09.823188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6958fa2d-5739-4e67-a0ed-c677cddc91ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:09.823657 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6958fa2d-5739-4e67-a0ed-c677cddc91ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:09.966828 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6958fa2d-5739-4e67-a0ed-c677cddc91ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:09.975654 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6958fa2d-5739-4e67-a0ed-c677cddc91ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165447 Jul 04 06:14:09.976203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 874/1758] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:09 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:10.822671 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6d5823e4-ca50-4d74-8d6c-6ebe3e409fe3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:10.823235 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6d5823e4-ca50-4d74-8d6c-6ebe3e409fe3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:10.829931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d5823e4-ca50-4d74-8d6c-6ebe3e409fe3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:10.830381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d5823e4-ca50-4d74-8d6c-6ebe3e409fe3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:10.831148 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d5823e4-ca50-4d74-8d6c-6ebe3e409fe3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:10.831613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d5823e4-ca50-4d74-8d6c-6ebe3e409fe3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:10.894327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6d5823e4-ca50-4d74-8d6c-6ebe3e409fe3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:10.903014 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6d5823e4-ca50-4d74-8d6c-6ebe3e409fe3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.084158 Jul 04 06:14:10.903661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 885/1759] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:10 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:10.996954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8fb04821-2889-4a46-a598-9435a2ce352f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:10.997948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8fb04821-2889-4a46-a598-9435a2ce352f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:11.008809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fb04821-2889-4a46-a598-9435a2ce352f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:11.009590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fb04821-2889-4a46-a598-9435a2ce352f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:11.010820 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fb04821-2889-4a46-a598-9435a2ce352f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:11.011595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fb04821-2889-4a46-a598-9435a2ce352f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:11.146515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8fb04821-2889-4a46-a598-9435a2ce352f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:11.159038 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8fb04821-2889-4a46-a598-9435a2ce352f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168240 Jul 04 06:14:11.159812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 875/1760] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:10 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:11.924539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fe092878-146f-436a-8438-8581918afb10 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:11.925285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fe092878-146f-436a-8438-8581918afb10 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:11.933473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe092878-146f-436a-8438-8581918afb10 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:11.934415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe092878-146f-436a-8438-8581918afb10 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:11.935402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe092878-146f-436a-8438-8581918afb10 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:11.935937 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe092878-146f-436a-8438-8581918afb10 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:12.007849 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fe092878-146f-436a-8438-8581918afb10 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:12.021951 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fe092878-146f-436a-8438-8581918afb10 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.103934 Jul 04 06:14:12.022539 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 886/1761] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:11 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:12.184354 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8444fd23-d150-4f87-b687-96a8fc586248 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:12.185289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8444fd23-d150-4f87-b687-96a8fc586248 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:12.193564 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8444fd23-d150-4f87-b687-96a8fc586248 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:12.194019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8444fd23-d150-4f87-b687-96a8fc586248 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:12.194785 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8444fd23-d150-4f87-b687-96a8fc586248 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:12.195224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8444fd23-d150-4f87-b687-96a8fc586248 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:12.339596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8444fd23-d150-4f87-b687-96a8fc586248 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:12.348361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8444fd23-d150-4f87-b687-96a8fc586248 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170584 Jul 04 06:14:12.348943 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 876/1762] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:12 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:13.047433 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d624e0df-f5a4-4b57-aa45-5fb4d71be557 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:13.048532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d624e0df-f5a4-4b57-aa45-5fb4d71be557 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:13.059670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d624e0df-f5a4-4b57-aa45-5fb4d71be557 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:13.060462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d624e0df-f5a4-4b57-aa45-5fb4d71be557 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:13.061731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d624e0df-f5a4-4b57-aa45-5fb4d71be557 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:13.062462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d624e0df-f5a4-4b57-aa45-5fb4d71be557 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:13.125640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d624e0df-f5a4-4b57-aa45-5fb4d71be557 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:13.133884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d624e0df-f5a4-4b57-aa45-5fb4d71be557 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093025 Jul 04 06:14:13.134463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 887/1763] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:13 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:13.370196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73d82900-f096-4a20-9dbb-2a395a4a8f8b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:13.371084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73d82900-f096-4a20-9dbb-2a395a4a8f8b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:13.382030 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73d82900-f096-4a20-9dbb-2a395a4a8f8b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:13.382770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73d82900-f096-4a20-9dbb-2a395a4a8f8b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:13.384118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73d82900-f096-4a20-9dbb-2a395a4a8f8b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:13.384843 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73d82900-f096-4a20-9dbb-2a395a4a8f8b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:13.522982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73d82900-f096-4a20-9dbb-2a395a4a8f8b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:13.531598 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73d82900-f096-4a20-9dbb-2a395a4a8f8b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168066 Jul 04 06:14:13.532205 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 877/1764] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:13 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:14.154382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dee64dfc-1274-4944-b1e2-177416a2305b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:14.155404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dee64dfc-1274-4944-b1e2-177416a2305b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:14.166393 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee64dfc-1274-4944-b1e2-177416a2305b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:14.167146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee64dfc-1274-4944-b1e2-177416a2305b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:14.168537 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee64dfc-1274-4944-b1e2-177416a2305b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:14.169266 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee64dfc-1274-4944-b1e2-177416a2305b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:14.235689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dee64dfc-1274-4944-b1e2-177416a2305b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:14.243973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dee64dfc-1274-4944-b1e2-177416a2305b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096500 Jul 04 06:14:14.244545 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 888/1765] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:14 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:14.549200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-439d6932-c031-4a13-9599-babd6e84d6af tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:14.549812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-439d6932-c031-4a13-9599-babd6e84d6af tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:14.557013 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-439d6932-c031-4a13-9599-babd6e84d6af tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:14.557467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-439d6932-c031-4a13-9599-babd6e84d6af tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:14.558227 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-439d6932-c031-4a13-9599-babd6e84d6af tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:14.558663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-439d6932-c031-4a13-9599-babd6e84d6af tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:14.699774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-439d6932-c031-4a13-9599-babd6e84d6af tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:14.709761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-439d6932-c031-4a13-9599-babd6e84d6af tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164505 Jul 04 06:14:14.710330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 878/1766] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:14 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:15.261573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-907e0bf1-d52e-40e4-ac7d-ab1418714b57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:15.262419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-907e0bf1-d52e-40e4-ac7d-ab1418714b57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:15.270220 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-907e0bf1-d52e-40e4-ac7d-ab1418714b57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:15.270687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-907e0bf1-d52e-40e4-ac7d-ab1418714b57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:15.271624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-907e0bf1-d52e-40e4-ac7d-ab1418714b57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:15.272100 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-907e0bf1-d52e-40e4-ac7d-ab1418714b57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:15.337884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-907e0bf1-d52e-40e4-ac7d-ab1418714b57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:15.346382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-907e0bf1-d52e-40e4-ac7d-ab1418714b57 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089179 Jul 04 06:14:15.347115 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 889/1767] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:15.730944 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b5d0cb4-503a-491a-973b-e47f1356bf12 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:15.731930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b5d0cb4-503a-491a-973b-e47f1356bf12 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:15.742851 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b5d0cb4-503a-491a-973b-e47f1356bf12 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:15.743482 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b5d0cb4-503a-491a-973b-e47f1356bf12 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:15.744556 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b5d0cb4-503a-491a-973b-e47f1356bf12 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:15.745011 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b5d0cb4-503a-491a-973b-e47f1356bf12 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:15.885248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b5d0cb4-503a-491a-973b-e47f1356bf12 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:15.893313 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b5d0cb4-503a-491a-973b-e47f1356bf12 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168964 Jul 04 06:14:15.893881 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 879/1768] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:15 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:16.367792 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-526499d5-df25-413d-a128-683cd307cf21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:16.368802 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-526499d5-df25-413d-a128-683cd307cf21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:16.379775 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-526499d5-df25-413d-a128-683cd307cf21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:16.380521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-526499d5-df25-413d-a128-683cd307cf21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:16.381780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-526499d5-df25-413d-a128-683cd307cf21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:16.382505 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-526499d5-df25-413d-a128-683cd307cf21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:16.452279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-526499d5-df25-413d-a128-683cd307cf21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:16.460975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-526499d5-df25-413d-a128-683cd307cf21 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.099800 Jul 04 06:14:16.461557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 890/1769] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:16.920720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-50701a00-4494-4c5f-a902-be85e588f04d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:16.921819 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-50701a00-4494-4c5f-a902-be85e588f04d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:16.930023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50701a00-4494-4c5f-a902-be85e588f04d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:16.930499 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50701a00-4494-4c5f-a902-be85e588f04d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:16.931290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50701a00-4494-4c5f-a902-be85e588f04d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:16.931741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50701a00-4494-4c5f-a902-be85e588f04d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:16.995279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:14:16.995584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:14:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f (ip 10.222.0.42) !!! Jul 04 06:14:17.076117 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-50701a00-4494-4c5f-a902-be85e588f04d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:17.084533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-50701a00-4494-4c5f-a902-be85e588f04d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170335 Jul 04 06:14:17.085075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 880/1770] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:16 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:17.478472 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-381015b3-0519-4c17-afff-45801ed89c54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:17.479079 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-381015b3-0519-4c17-afff-45801ed89c54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:17.486048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381015b3-0519-4c17-afff-45801ed89c54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:17.486495 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381015b3-0519-4c17-afff-45801ed89c54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:17.487280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381015b3-0519-4c17-afff-45801ed89c54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:17.487747 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381015b3-0519-4c17-afff-45801ed89c54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:17.552615 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-381015b3-0519-4c17-afff-45801ed89c54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:17.560682 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-381015b3-0519-4c17-afff-45801ed89c54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086143 Jul 04 06:14:17.561265 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 891/1771] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:18.105682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-469aa754-c3a8-4555-a767-3c9ea5a813f4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:18.106484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-469aa754-c3a8-4555-a767-3c9ea5a813f4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:18.115558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-469aa754-c3a8-4555-a767-3c9ea5a813f4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:18.116011 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-469aa754-c3a8-4555-a767-3c9ea5a813f4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:18.116783 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-469aa754-c3a8-4555-a767-3c9ea5a813f4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:18.117221 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-469aa754-c3a8-4555-a767-3c9ea5a813f4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:18.254477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-469aa754-c3a8-4555-a767-3c9ea5a813f4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:18.263074 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-469aa754-c3a8-4555-a767-3c9ea5a813f4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163859 Jul 04 06:14:18.263670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 881/1772] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:18 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:18.581858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-432c4895-e25e-4104-b6db-dfaa1d1594b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:18.583034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-432c4895-e25e-4104-b6db-dfaa1d1594b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:18.594000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-432c4895-e25e-4104-b6db-dfaa1d1594b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:18.594751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-432c4895-e25e-4104-b6db-dfaa1d1594b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:18.596063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-432c4895-e25e-4104-b6db-dfaa1d1594b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:18.596794 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-432c4895-e25e-4104-b6db-dfaa1d1594b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:18.663289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-432c4895-e25e-4104-b6db-dfaa1d1594b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:18.675568 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-432c4895-e25e-4104-b6db-dfaa1d1594b2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.100179 Jul 04 06:14:18.676373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 892/1773] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:19.285417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0d8e1802-3d3f-42d1-9566-c9a2a6375e4f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:19.286223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0d8e1802-3d3f-42d1-9566-c9a2a6375e4f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:19.293401 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d8e1802-3d3f-42d1-9566-c9a2a6375e4f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:19.293852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d8e1802-3d3f-42d1-9566-c9a2a6375e4f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:19.294618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d8e1802-3d3f-42d1-9566-c9a2a6375e4f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:19.295035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d8e1802-3d3f-42d1-9566-c9a2a6375e4f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:19.442100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0d8e1802-3d3f-42d1-9566-c9a2a6375e4f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:19.450650 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0d8e1802-3d3f-42d1-9566-c9a2a6375e4f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.171700 Jul 04 06:14:19.451228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 882/1774] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:19 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:19.696150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-925db8d0-7255-4113-8758-46fe04257312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:19.697001 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-925db8d0-7255-4113-8758-46fe04257312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:19.707909 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-925db8d0-7255-4113-8758-46fe04257312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:19.708361 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-925db8d0-7255-4113-8758-46fe04257312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:19.709171 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-925db8d0-7255-4113-8758-46fe04257312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:19.709617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-925db8d0-7255-4113-8758-46fe04257312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:19.724682 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:14:20.025112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-925db8d0-7255-4113-8758-46fe04257312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:20.037236 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-925db8d0-7255-4113-8758-46fe04257312 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.347920 Jul 04 06:14:20.037786 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 893/1775] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:20.472418 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e75d432-228e-4e48-bd11-330e95353271 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:20.473310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e75d432-228e-4e48-bd11-330e95353271 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:20.484313 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e75d432-228e-4e48-bd11-330e95353271 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:20.485070 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e75d432-228e-4e48-bd11-330e95353271 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:20.486347 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e75d432-228e-4e48-bd11-330e95353271 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:20.487077 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e75d432-228e-4e48-bd11-330e95353271 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:20.634434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6e75d432-228e-4e48-bd11-330e95353271 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:20.642697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e75d432-228e-4e48-bd11-330e95353271 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.176980 Jul 04 06:14:20.643304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 883/1776] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:20 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:21.054268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2bc8d3e0-1bf2-45fe-a788-242cdbd14d62 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:21.054929 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2bc8d3e0-1bf2-45fe-a788-242cdbd14d62 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:21.061798 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bc8d3e0-1bf2-45fe-a788-242cdbd14d62 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:21.062305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bc8d3e0-1bf2-45fe-a788-242cdbd14d62 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:21.063050 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bc8d3e0-1bf2-45fe-a788-242cdbd14d62 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:21.063507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bc8d3e0-1bf2-45fe-a788-242cdbd14d62 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:21.132713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2bc8d3e0-1bf2-45fe-a788-242cdbd14d62 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:21.140968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2bc8d3e0-1bf2-45fe-a788-242cdbd14d62 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090752 Jul 04 06:14:21.141547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 894/1777] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:21.664202 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b32d00af-5fc8-49b5-9eae-5960d682ab6b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:21.665298 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b32d00af-5fc8-49b5-9eae-5960d682ab6b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:21.676197 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b32d00af-5fc8-49b5-9eae-5960d682ab6b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:21.676976 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b32d00af-5fc8-49b5-9eae-5960d682ab6b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:21.678239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b32d00af-5fc8-49b5-9eae-5960d682ab6b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:21.678968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b32d00af-5fc8-49b5-9eae-5960d682ab6b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:21.821751 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b32d00af-5fc8-49b5-9eae-5960d682ab6b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:21.834619 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b32d00af-5fc8-49b5-9eae-5960d682ab6b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.176995 Jul 04 06:14:21.835193 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 884/1778] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:21 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:22.162741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cff345cf-c1d3-477a-9f09-f8110652a723 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:22.163483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cff345cf-c1d3-477a-9f09-f8110652a723 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:22.172174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cff345cf-c1d3-477a-9f09-f8110652a723 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:22.172741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cff345cf-c1d3-477a-9f09-f8110652a723 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:22.173693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cff345cf-c1d3-477a-9f09-f8110652a723 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:22.174235 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cff345cf-c1d3-477a-9f09-f8110652a723 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:22.238924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cff345cf-c1d3-477a-9f09-f8110652a723 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:22.248088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cff345cf-c1d3-477a-9f09-f8110652a723 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091921 Jul 04 06:14:22.248659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 895/1779] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:22.852517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61438029-e89e-49cf-ad7c-63de50256ca3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:22.853164 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61438029-e89e-49cf-ad7c-63de50256ca3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:22.859903 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61438029-e89e-49cf-ad7c-63de50256ca3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:22.860362 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61438029-e89e-49cf-ad7c-63de50256ca3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:22.862041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61438029-e89e-49cf-ad7c-63de50256ca3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:22.862041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61438029-e89e-49cf-ad7c-63de50256ca3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:22.995551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61438029-e89e-49cf-ad7c-63de50256ca3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:23.003654 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61438029-e89e-49cf-ad7c-63de50256ca3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.155284 Jul 04 06:14:23.004242 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 885/1780] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:22 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:23.264965 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a7c27bf3-d6c7-4509-8812-a6c791c9bbd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:23.265585 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a7c27bf3-d6c7-4509-8812-a6c791c9bbd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:23.272547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7c27bf3-d6c7-4509-8812-a6c791c9bbd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:23.273001 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7c27bf3-d6c7-4509-8812-a6c791c9bbd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:23.273770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7c27bf3-d6c7-4509-8812-a6c791c9bbd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:23.274534 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7c27bf3-d6c7-4509-8812-a6c791c9bbd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:23.368922 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a7c27bf3-d6c7-4509-8812-a6c791c9bbd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:23.381632 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a7c27bf3-d6c7-4509-8812-a6c791c9bbd4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.120495 Jul 04 06:14:23.382352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 896/1781] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:24.025529 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d9c54e17-4e43-4b51-a24d-104d1a27bb2b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:24.026510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d9c54e17-4e43-4b51-a24d-104d1a27bb2b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:24.038089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9c54e17-4e43-4b51-a24d-104d1a27bb2b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:24.038844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9c54e17-4e43-4b51-a24d-104d1a27bb2b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:24.040163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9c54e17-4e43-4b51-a24d-104d1a27bb2b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:24.040891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9c54e17-4e43-4b51-a24d-104d1a27bb2b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:24.190443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d9c54e17-4e43-4b51-a24d-104d1a27bb2b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:24.201721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d9c54e17-4e43-4b51-a24d-104d1a27bb2b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.182948 Jul 04 06:14:24.202527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 886/1782] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:24 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:24.406237 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e1926299-9474-414e-b870-2998ba93fc4a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:24.407035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e1926299-9474-414e-b870-2998ba93fc4a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:24.415988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1926299-9474-414e-b870-2998ba93fc4a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:24.416429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1926299-9474-414e-b870-2998ba93fc4a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:24.417184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1926299-9474-414e-b870-2998ba93fc4a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:24.417610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1926299-9474-414e-b870-2998ba93fc4a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:24.480285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e1926299-9474-414e-b870-2998ba93fc4a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:24.488468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e1926299-9474-414e-b870-2998ba93fc4a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088884 Jul 04 06:14:24.489028 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 897/1783] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:25.223272 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-19b85c92-bc54-4a81-b333-3e86c08b5100 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:25.224321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-19b85c92-bc54-4a81-b333-3e86c08b5100 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:25.231802 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19b85c92-bc54-4a81-b333-3e86c08b5100 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:25.232255 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19b85c92-bc54-4a81-b333-3e86c08b5100 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:25.233024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19b85c92-bc54-4a81-b333-3e86c08b5100 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:25.233455 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19b85c92-bc54-4a81-b333-3e86c08b5100 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:25.371738 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-19b85c92-bc54-4a81-b333-3e86c08b5100 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:25.380131 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-19b85c92-bc54-4a81-b333-3e86c08b5100 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163357 Jul 04 06:14:25.380704 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 887/1784] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:25 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:25.509213 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-91c8b07b-4e0b-4f6f-ae40-b237a2a4f135 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:25.510451 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-91c8b07b-4e0b-4f6f-ae40-b237a2a4f135 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:25.522712 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91c8b07b-4e0b-4f6f-ae40-b237a2a4f135 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:25.522712 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91c8b07b-4e0b-4f6f-ae40-b237a2a4f135 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:25.523559 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91c8b07b-4e0b-4f6f-ae40-b237a2a4f135 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:25.523995 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91c8b07b-4e0b-4f6f-ae40-b237a2a4f135 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:25.590371 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-91c8b07b-4e0b-4f6f-ae40-b237a2a4f135 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:25.603437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-91c8b07b-4e0b-4f6f-ae40-b237a2a4f135 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.100679 Jul 04 06:14:25.604472 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 898/1785] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:26.401387 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-670bef50-b59d-40fe-930d-1eb9cfe6b6ca tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:26.402406 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-670bef50-b59d-40fe-930d-1eb9cfe6b6ca tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:26.414009 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-670bef50-b59d-40fe-930d-1eb9cfe6b6ca tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:26.414747 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-670bef50-b59d-40fe-930d-1eb9cfe6b6ca tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:26.416128 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-670bef50-b59d-40fe-930d-1eb9cfe6b6ca tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:26.416848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-670bef50-b59d-40fe-930d-1eb9cfe6b6ca tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:26.436453 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:14:26.553573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-670bef50-b59d-40fe-930d-1eb9cfe6b6ca tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:26.562174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-670bef50-b59d-40fe-930d-1eb9cfe6b6ca tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167513 Jul 04 06:14:26.562744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 888/1786] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:26 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:26.625533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bcc1125f-f302-4751-acd1-842a5215dc96 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:26.626147 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bcc1125f-f302-4751-acd1-842a5215dc96 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:26.633289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bcc1125f-f302-4751-acd1-842a5215dc96 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:26.633782 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bcc1125f-f302-4751-acd1-842a5215dc96 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:26.634550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bcc1125f-f302-4751-acd1-842a5215dc96 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:26.634989 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bcc1125f-f302-4751-acd1-842a5215dc96 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:26.706310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bcc1125f-f302-4751-acd1-842a5215dc96 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:26.714699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bcc1125f-f302-4751-acd1-842a5215dc96 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093187 Jul 04 06:14:26.715278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 899/1787] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:27.579635 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef772c98-95f1-460c-b96c-0cb42dc76118 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:27.580250 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef772c98-95f1-460c-b96c-0cb42dc76118 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:27.587264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef772c98-95f1-460c-b96c-0cb42dc76118 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:27.587755 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef772c98-95f1-460c-b96c-0cb42dc76118 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:27.589239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef772c98-95f1-460c-b96c-0cb42dc76118 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:27.589878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef772c98-95f1-460c-b96c-0cb42dc76118 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:27.725815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef772c98-95f1-460c-b96c-0cb42dc76118 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:27.730575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dd9b2580-15cd-475e-b0e8-8626ba4bb8dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:27.731178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dd9b2580-15cd-475e-b0e8-8626ba4bb8dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:27.734194 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef772c98-95f1-460c-b96c-0cb42dc76118 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158585 Jul 04 06:14:27.734976 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 889/1788] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:27 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:27.738082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd9b2580-15cd-475e-b0e8-8626ba4bb8dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:27.738510 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd9b2580-15cd-475e-b0e8-8626ba4bb8dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:27.739279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd9b2580-15cd-475e-b0e8-8626ba4bb8dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:27.739733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd9b2580-15cd-475e-b0e8-8626ba4bb8dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:27.805421 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd9b2580-15cd-475e-b0e8-8626ba4bb8dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:27.814234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dd9b2580-15cd-475e-b0e8-8626ba4bb8dc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087587 Jul 04 06:14:27.814815 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 900/1789] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:14:28.755847 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-441fc7a3-3fdd-4c26-80b0-cdef86092e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:28.756909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-441fc7a3-3fdd-4c26-80b0-cdef86092e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:28.767650 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441fc7a3-3fdd-4c26-80b0-cdef86092e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:28.768411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441fc7a3-3fdd-4c26-80b0-cdef86092e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:28.769685 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441fc7a3-3fdd-4c26-80b0-cdef86092e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:28.770409 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441fc7a3-3fdd-4c26-80b0-cdef86092e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:28.831199 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1178d183-a1e3-43c6-89d6-a518ef83c317 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:28.831874 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1178d183-a1e3-43c6-89d6-a518ef83c317 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:28.838488 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1178d183-a1e3-43c6-89d6-a518ef83c317 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:28.838946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1178d183-a1e3-43c6-89d6-a518ef83c317 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:28.839736 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1178d183-a1e3-43c6-89d6-a518ef83c317 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:28.840191 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1178d183-a1e3-43c6-89d6-a518ef83c317 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:28.901347 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1178d183-a1e3-43c6-89d6-a518ef83c317 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:28.909840 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1178d183-a1e3-43c6-89d6-a518ef83c317 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.082677 Jul 04 06:14:28.910417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 901/1790] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:14:28.913578 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-441fc7a3-3fdd-4c26-80b0-cdef86092e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:28.921833 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-441fc7a3-3fdd-4c26-80b0-cdef86092e70 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.172751 Jul 04 06:14:28.922391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 890/1791] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:28 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:29.592055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:14:29.592364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:14:29.930689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5c570ff2-a7c0-409a-a5fd-27f68bca2886 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:29.931685 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5c570ff2-a7c0-409a-a5fd-27f68bca2886 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:29.939235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef57f7e1-20f0-458d-bff6-3ac7caada476 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:29.939773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c570ff2-a7c0-409a-a5fd-27f68bca2886 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:29.939970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef57f7e1-20f0-458d-bff6-3ac7caada476 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:29.940077 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c570ff2-a7c0-409a-a5fd-27f68bca2886 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:29.940831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c570ff2-a7c0-409a-a5fd-27f68bca2886 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:29.941305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c570ff2-a7c0-409a-a5fd-27f68bca2886 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:29.946937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef57f7e1-20f0-458d-bff6-3ac7caada476 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:29.947473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef57f7e1-20f0-458d-bff6-3ac7caada476 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:29.948405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef57f7e1-20f0-458d-bff6-3ac7caada476 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:29.948860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef57f7e1-20f0-458d-bff6-3ac7caada476 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:30.005740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c570ff2-a7c0-409a-a5fd-27f68bca2886 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:30.014602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5c570ff2-a7c0-409a-a5fd-27f68bca2886 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090349 Jul 04 06:14:30.015194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 902/1792] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:30.078672 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef57f7e1-20f0-458d-bff6-3ac7caada476 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:30.086554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef57f7e1-20f0-458d-bff6-3ac7caada476 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.151565 Jul 04 06:14:30.087088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 891/1793] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:29 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:31.032153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a793549b-24fc-4aa0-8c77-e6b4afee1080 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:31.032803 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a793549b-24fc-4aa0-8c77-e6b4afee1080 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:31.039862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a793549b-24fc-4aa0-8c77-e6b4afee1080 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:31.040331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a793549b-24fc-4aa0-8c77-e6b4afee1080 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:31.041123 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a793549b-24fc-4aa0-8c77-e6b4afee1080 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:31.041711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a793549b-24fc-4aa0-8c77-e6b4afee1080 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:31.102897 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a793549b-24fc-4aa0-8c77-e6b4afee1080 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:31.103659 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-98b31eec-e0d8-4c2a-b407-88a76028580f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:31.104412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-98b31eec-e0d8-4c2a-b407-88a76028580f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:31.111281 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98b31eec-e0d8-4c2a-b407-88a76028580f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:31.111527 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a793549b-24fc-4aa0-8c77-e6b4afee1080 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.083999 Jul 04 06:14:31.111754 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98b31eec-e0d8-4c2a-b407-88a76028580f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:31.112124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 903/1794] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:31 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:31.112543 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98b31eec-e0d8-4c2a-b407-88a76028580f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:31.113029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-98b31eec-e0d8-4c2a-b407-88a76028580f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:31.250972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-98b31eec-e0d8-4c2a-b407-88a76028580f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:31.259521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-98b31eec-e0d8-4c2a-b407-88a76028580f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159703 Jul 04 06:14:31.260057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 892/1795] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:31 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:32.132478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d78c8302-93a6-4be4-be6e-003e5831dfcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:32.133691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d78c8302-93a6-4be4-be6e-003e5831dfcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:32.141569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d78c8302-93a6-4be4-be6e-003e5831dfcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:32.142022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d78c8302-93a6-4be4-be6e-003e5831dfcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:32.142789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d78c8302-93a6-4be4-be6e-003e5831dfcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:32.143282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d78c8302-93a6-4be4-be6e-003e5831dfcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:32.209447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d78c8302-93a6-4be4-be6e-003e5831dfcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:32.219724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d78c8302-93a6-4be4-be6e-003e5831dfcf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093522 Jul 04 06:14:32.220657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 904/1796] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:32 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:32.282509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6974b1f3-28e9-4774-bfc4-c7636b9ddd99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:32.283129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6974b1f3-28e9-4774-bfc4-c7636b9ddd99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:32.290597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6974b1f3-28e9-4774-bfc4-c7636b9ddd99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:32.291045 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6974b1f3-28e9-4774-bfc4-c7636b9ddd99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:32.291848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6974b1f3-28e9-4774-bfc4-c7636b9ddd99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:32.292364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6974b1f3-28e9-4774-bfc4-c7636b9ddd99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:32.446161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6974b1f3-28e9-4774-bfc4-c7636b9ddd99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:32.454473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6974b1f3-28e9-4774-bfc4-c7636b9ddd99 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.175906 Jul 04 06:14:32.455056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 893/1797] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:32 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:33.247240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-63f6c060-55e1-4688-ae93-98719e0afcf5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:33.248262 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-63f6c060-55e1-4688-ae93-98719e0afcf5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:33.259315 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63f6c060-55e1-4688-ae93-98719e0afcf5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:33.260094 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63f6c060-55e1-4688-ae93-98719e0afcf5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:33.261297 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63f6c060-55e1-4688-ae93-98719e0afcf5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:33.261708 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63f6c060-55e1-4688-ae93-98719e0afcf5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:33.337700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-63f6c060-55e1-4688-ae93-98719e0afcf5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:33.346154 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-63f6c060-55e1-4688-ae93-98719e0afcf5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.105482 Jul 04 06:14:33.346768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 905/1798] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:33.477656 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c1e0c9f6-32fc-43a3-9e28-ad52dd418cc3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:33.478676 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c1e0c9f6-32fc-43a3-9e28-ad52dd418cc3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:33.489740 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1e0c9f6-32fc-43a3-9e28-ad52dd418cc3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:33.490490 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1e0c9f6-32fc-43a3-9e28-ad52dd418cc3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:33.491827 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1e0c9f6-32fc-43a3-9e28-ad52dd418cc3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:33.492554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1e0c9f6-32fc-43a3-9e28-ad52dd418cc3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:33.625160 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c1e0c9f6-32fc-43a3-9e28-ad52dd418cc3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:33.633424 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c1e0c9f6-32fc-43a3-9e28-ad52dd418cc3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164216 Jul 04 06:14:33.633993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 894/1799] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:33 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:34.363438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a061eb96-9fca-46be-869e-ab7b808e38da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:34.364110 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a061eb96-9fca-46be-869e-ab7b808e38da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:34.370666 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a061eb96-9fca-46be-869e-ab7b808e38da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:34.371143 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a061eb96-9fca-46be-869e-ab7b808e38da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:34.372212 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a061eb96-9fca-46be-869e-ab7b808e38da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:34.372660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a061eb96-9fca-46be-869e-ab7b808e38da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:34.441502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a061eb96-9fca-46be-869e-ab7b808e38da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:34.452459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a061eb96-9fca-46be-869e-ab7b808e38da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093049 Jul 04 06:14:34.453018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 906/1800] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:34.654688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73fe6747-962c-4c45-ba7e-9fce306bc294 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:34.655739 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73fe6747-962c-4c45-ba7e-9fce306bc294 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:34.666737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73fe6747-962c-4c45-ba7e-9fce306bc294 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:34.667540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73fe6747-962c-4c45-ba7e-9fce306bc294 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:34.668757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73fe6747-962c-4c45-ba7e-9fce306bc294 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:34.669189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73fe6747-962c-4c45-ba7e-9fce306bc294 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:34.808153 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73fe6747-962c-4c45-ba7e-9fce306bc294 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:34.816645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73fe6747-962c-4c45-ba7e-9fce306bc294 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169158 Jul 04 06:14:34.817214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 895/1801] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:34 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:35.473683 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-81fe5271-eaf4-4d44-80c7-98dedef0bab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:35.474547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-81fe5271-eaf4-4d44-80c7-98dedef0bab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:35.484195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81fe5271-eaf4-4d44-80c7-98dedef0bab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:35.484642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81fe5271-eaf4-4d44-80c7-98dedef0bab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:35.485395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81fe5271-eaf4-4d44-80c7-98dedef0bab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:35.485822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81fe5271-eaf4-4d44-80c7-98dedef0bab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:35.551762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-81fe5271-eaf4-4d44-80c7-98dedef0bab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:35.560245 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-81fe5271-eaf4-4d44-80c7-98dedef0bab9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093324 Jul 04 06:14:35.560805 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 907/1802] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:35.837836 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-430c2e34-5563-4b0a-93ee-9f6ae95d0659 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:35.838773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-430c2e34-5563-4b0a-93ee-9f6ae95d0659 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:35.841876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:14:35.847618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-430c2e34-5563-4b0a-93ee-9f6ae95d0659 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:35.848087 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-430c2e34-5563-4b0a-93ee-9f6ae95d0659 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:35.848847 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-430c2e34-5563-4b0a-93ee-9f6ae95d0659 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:35.849280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-430c2e34-5563-4b0a-93ee-9f6ae95d0659 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:35.986724 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-430c2e34-5563-4b0a-93ee-9f6ae95d0659 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:35.995038 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-430c2e34-5563-4b0a-93ee-9f6ae95d0659 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163733 Jul 04 06:14:35.995655 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 896/1803] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:35 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:36.581075 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea5aa38b-2fc1-4d09-aba8-800dd6e384f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:36.582075 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea5aa38b-2fc1-4d09-aba8-800dd6e384f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:36.592094 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea5aa38b-2fc1-4d09-aba8-800dd6e384f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:36.592554 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea5aa38b-2fc1-4d09-aba8-800dd6e384f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:36.593293 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea5aa38b-2fc1-4d09-aba8-800dd6e384f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:36.593755 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea5aa38b-2fc1-4d09-aba8-800dd6e384f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:36.662529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea5aa38b-2fc1-4d09-aba8-800dd6e384f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:36.671044 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea5aa38b-2fc1-4d09-aba8-800dd6e384f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096504 Jul 04 06:14:36.671654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 908/1804] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:37.016968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2fd62b98-4155-4904-93cc-9dbcb01f9065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:37.018032 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2fd62b98-4155-4904-93cc-9dbcb01f9065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:37.028901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fd62b98-4155-4904-93cc-9dbcb01f9065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:37.029352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fd62b98-4155-4904-93cc-9dbcb01f9065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:37.030122 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fd62b98-4155-4904-93cc-9dbcb01f9065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:37.030559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fd62b98-4155-4904-93cc-9dbcb01f9065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:37.182055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2fd62b98-4155-4904-93cc-9dbcb01f9065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:37.191081 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2fd62b98-4155-4904-93cc-9dbcb01f9065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.180731 Jul 04 06:14:37.191688 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 897/1805] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:37 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:37.687863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6107e152-14d3-4d11-9403-e02cc1252b11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:37.688480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6107e152-14d3-4d11-9403-e02cc1252b11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:37.690816 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=54 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:14:37.696356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6107e152-14d3-4d11-9403-e02cc1252b11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:37.696807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6107e152-14d3-4d11-9403-e02cc1252b11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:37.697576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6107e152-14d3-4d11-9403-e02cc1252b11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:37.698014 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6107e152-14d3-4d11-9403-e02cc1252b11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:37.762792 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6107e152-14d3-4d11-9403-e02cc1252b11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:37.775512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6107e152-14d3-4d11-9403-e02cc1252b11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091316 Jul 04 06:14:37.776335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 909/1806] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:38.212257 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61e2400c-11df-4ef7-8a22-b5f1d7f6f44f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:38.213310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61e2400c-11df-4ef7-8a22-b5f1d7f6f44f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:38.224669 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e2400c-11df-4ef7-8a22-b5f1d7f6f44f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:38.225493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e2400c-11df-4ef7-8a22-b5f1d7f6f44f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:38.226766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e2400c-11df-4ef7-8a22-b5f1d7f6f44f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:38.227566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e2400c-11df-4ef7-8a22-b5f1d7f6f44f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:38.380136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61e2400c-11df-4ef7-8a22-b5f1d7f6f44f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:38.388814 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61e2400c-11df-4ef7-8a22-b5f1d7f6f44f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.183079 Jul 04 06:14:38.389350 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 898/1807] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:38 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:38.797000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ae0a828-7bc1-4244-b636-b67ce3992109 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:38.797889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ae0a828-7bc1-4244-b636-b67ce3992109 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:38.809148 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ae0a828-7bc1-4244-b636-b67ce3992109 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:38.809587 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ae0a828-7bc1-4244-b636-b67ce3992109 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:38.810354 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ae0a828-7bc1-4244-b636-b67ce3992109 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:38.810781 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ae0a828-7bc1-4244-b636-b67ce3992109 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:38.813334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:14:38.873874 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ae0a828-7bc1-4244-b636-b67ce3992109 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:38.882211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ae0a828-7bc1-4244-b636-b67ce3992109 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092002 Jul 04 06:14:38.882782 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 910/1808] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:39.408805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-15e466e6-5d3d-4290-b09c-4025d4cf76c8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:39.409592 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-15e466e6-5d3d-4290-b09c-4025d4cf76c8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:39.418653 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15e466e6-5d3d-4290-b09c-4025d4cf76c8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:39.419280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15e466e6-5d3d-4290-b09c-4025d4cf76c8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:39.420315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15e466e6-5d3d-4290-b09c-4025d4cf76c8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:39.420884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15e466e6-5d3d-4290-b09c-4025d4cf76c8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:39.568818 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-15e466e6-5d3d-4290-b09c-4025d4cf76c8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:39.581380 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-15e466e6-5d3d-4290-b09c-4025d4cf76c8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.177828 Jul 04 06:14:39.582168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 899/1809] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:39 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:39.900421 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9f6198e4-5548-4e44-8a66-71977dc5896c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:39.901103 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9f6198e4-5548-4e44-8a66-71977dc5896c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:39.909314 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f6198e4-5548-4e44-8a66-71977dc5896c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:39.909806 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f6198e4-5548-4e44-8a66-71977dc5896c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:39.910641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f6198e4-5548-4e44-8a66-71977dc5896c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:39.911118 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f6198e4-5548-4e44-8a66-71977dc5896c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:39.976192 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9f6198e4-5548-4e44-8a66-71977dc5896c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:39.984944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9f6198e4-5548-4e44-8a66-71977dc5896c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089318 Jul 04 06:14:39.985487 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 911/1810] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:40.605468 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-119f81e7-397f-4633-8343-cf228e9e4b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:40.606373 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-119f81e7-397f-4633-8343-cf228e9e4b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:40.613223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-119f81e7-397f-4633-8343-cf228e9e4b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:40.613665 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-119f81e7-397f-4633-8343-cf228e9e4b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:40.614421 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-119f81e7-397f-4633-8343-cf228e9e4b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:40.614849 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-119f81e7-397f-4633-8343-cf228e9e4b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:40.754816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-119f81e7-397f-4633-8343-cf228e9e4b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:40.768284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-119f81e7-397f-4633-8343-cf228e9e4b02 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168864 Jul 04 06:14:40.768942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 900/1811] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:40 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:41.005759 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0d172e2e-5830-4abe-91f3-3d6610394bb3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:41.007008 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0d172e2e-5830-4abe-91f3-3d6610394bb3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:41.018144 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d172e2e-5830-4abe-91f3-3d6610394bb3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:41.019000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d172e2e-5830-4abe-91f3-3d6610394bb3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:41.020225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d172e2e-5830-4abe-91f3-3d6610394bb3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:41.020947 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d172e2e-5830-4abe-91f3-3d6610394bb3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:41.088870 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0d172e2e-5830-4abe-91f3-3d6610394bb3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:41.097141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0d172e2e-5830-4abe-91f3-3d6610394bb3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097919 Jul 04 06:14:41.097709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 912/1812] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:41.790334 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-95289084-28bf-43bb-b8ce-08ad38a6ee5d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:41.790926 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-95289084-28bf-43bb-b8ce-08ad38a6ee5d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:41.797956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95289084-28bf-43bb-b8ce-08ad38a6ee5d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:41.798414 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95289084-28bf-43bb-b8ce-08ad38a6ee5d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:41.799176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95289084-28bf-43bb-b8ce-08ad38a6ee5d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:41.799644 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95289084-28bf-43bb-b8ce-08ad38a6ee5d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:41.935239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-95289084-28bf-43bb-b8ce-08ad38a6ee5d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:41.943417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-95289084-28bf-43bb-b8ce-08ad38a6ee5d tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.157138 Jul 04 06:14:41.943989 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 901/1813] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:41 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:42.117952 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac2dd851-a268-4227-b2fb-ec90d692d9d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:42.118792 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ac2dd851-a268-4227-b2fb-ec90d692d9d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:42.129659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac2dd851-a268-4227-b2fb-ec90d692d9d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:42.130442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac2dd851-a268-4227-b2fb-ec90d692d9d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:42.131796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac2dd851-a268-4227-b2fb-ec90d692d9d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:42.132520 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac2dd851-a268-4227-b2fb-ec90d692d9d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:42.195686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ac2dd851-a268-4227-b2fb-ec90d692d9d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:42.204014 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ac2dd851-a268-4227-b2fb-ec90d692d9d4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092760 Jul 04 06:14:42.204581 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 913/1814] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:42 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:42.965034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d2dfeee5-3a7c-437c-b99b-4b1f0ba78405 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:42.965973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d2dfeee5-3a7c-437c-b99b-4b1f0ba78405 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:42.973211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2dfeee5-3a7c-437c-b99b-4b1f0ba78405 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:42.973662 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2dfeee5-3a7c-437c-b99b-4b1f0ba78405 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:42.974428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2dfeee5-3a7c-437c-b99b-4b1f0ba78405 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:42.974866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2dfeee5-3a7c-437c-b99b-4b1f0ba78405 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:43.109813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2dfeee5-3a7c-437c-b99b-4b1f0ba78405 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:43.118117 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d2dfeee5-3a7c-437c-b99b-4b1f0ba78405 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159907 Jul 04 06:14:43.118675 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 902/1815] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:42 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:43.225150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0d6a4def-0aad-43f2-8414-c88194bcfc09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:43.226038 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0d6a4def-0aad-43f2-8414-c88194bcfc09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:43.237421 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d6a4def-0aad-43f2-8414-c88194bcfc09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:43.238172 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d6a4def-0aad-43f2-8414-c88194bcfc09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:43.239498 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d6a4def-0aad-43f2-8414-c88194bcfc09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:43.240227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d6a4def-0aad-43f2-8414-c88194bcfc09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:43.304176 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0d6a4def-0aad-43f2-8414-c88194bcfc09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:43.312579 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0d6a4def-0aad-43f2-8414-c88194bcfc09 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094202 Jul 04 06:14:43.313150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 914/1816] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:44.139483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f462e169-8d69-471f-8ad2-4227b70c9029 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:44.140141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f462e169-8d69-471f-8ad2-4227b70c9029 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:44.147342 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f462e169-8d69-471f-8ad2-4227b70c9029 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:44.147817 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f462e169-8d69-471f-8ad2-4227b70c9029 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:44.148629 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f462e169-8d69-471f-8ad2-4227b70c9029 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:44.149093 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f462e169-8d69-471f-8ad2-4227b70c9029 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:44.293149 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f462e169-8d69-471f-8ad2-4227b70c9029 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:44.302010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f462e169-8d69-471f-8ad2-4227b70c9029 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168968 Jul 04 06:14:44.302597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 903/1817] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:44 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:44.330345 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-51a228d8-0436-4ae5-a932-4292eba3141e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:44.331163 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-51a228d8-0436-4ae5-a932-4292eba3141e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:44.340716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51a228d8-0436-4ae5-a932-4292eba3141e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:44.341368 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51a228d8-0436-4ae5-a932-4292eba3141e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:44.342660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51a228d8-0436-4ae5-a932-4292eba3141e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:44.343406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51a228d8-0436-4ae5-a932-4292eba3141e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:44.416052 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-51a228d8-0436-4ae5-a932-4292eba3141e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:44.426138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-51a228d8-0436-4ae5-a932-4292eba3141e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.100657 Jul 04 06:14:44.426714 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 915/1818] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:44 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:45.323588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-52e6b04d-4538-4e4d-b00c-5ac0f0bfa6fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:45.324539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-52e6b04d-4538-4e4d-b00c-5ac0f0bfa6fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:45.335622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52e6b04d-4538-4e4d-b00c-5ac0f0bfa6fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:45.336361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52e6b04d-4538-4e4d-b00c-5ac0f0bfa6fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:45.337646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52e6b04d-4538-4e4d-b00c-5ac0f0bfa6fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:45.338361 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52e6b04d-4538-4e4d-b00c-5ac0f0bfa6fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:45.443185 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-36a63b3b-1afb-4e38-b6a7-8802b7e98690 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:45.443872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-36a63b3b-1afb-4e38-b6a7-8802b7e98690 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:45.450757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36a63b3b-1afb-4e38-b6a7-8802b7e98690 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:45.451268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36a63b3b-1afb-4e38-b6a7-8802b7e98690 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:45.452056 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36a63b3b-1afb-4e38-b6a7-8802b7e98690 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:45.452492 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36a63b3b-1afb-4e38-b6a7-8802b7e98690 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:45.471533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-52e6b04d-4538-4e4d-b00c-5ac0f0bfa6fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:45.479821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-52e6b04d-4538-4e4d-b00c-5ac0f0bfa6fb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162747 Jul 04 06:14:45.480597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 904/1819] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:45 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:45.517093 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36a63b3b-1afb-4e38-b6a7-8802b7e98690 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:45.525824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-36a63b3b-1afb-4e38-b6a7-8802b7e98690 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086597 Jul 04 06:14:45.526401 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 916/1820] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:46.502010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bbfdcb07-0adf-4e62-91f0-646fa705c6c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:46.503008 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bbfdcb07-0adf-4e62-91f0-646fa705c6c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:46.514525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbfdcb07-0adf-4e62-91f0-646fa705c6c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:46.515089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbfdcb07-0adf-4e62-91f0-646fa705c6c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:46.515974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbfdcb07-0adf-4e62-91f0-646fa705c6c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:46.516465 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbfdcb07-0adf-4e62-91f0-646fa705c6c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:46.519672 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:14:46.543780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c91efedb-9941-4dcf-af96-e5da3497e7ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:46.544399 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c91efedb-9941-4dcf-af96-e5da3497e7ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:46.551403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c91efedb-9941-4dcf-af96-e5da3497e7ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:46.551855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c91efedb-9941-4dcf-af96-e5da3497e7ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:46.552623 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c91efedb-9941-4dcf-af96-e5da3497e7ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:46.553031 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c91efedb-9941-4dcf-af96-e5da3497e7ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:46.618940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c91efedb-9941-4dcf-af96-e5da3497e7ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:46.626953 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c91efedb-9941-4dcf-af96-e5da3497e7ad tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087318 Jul 04 06:14:46.627614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 917/1821] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:46 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:46.649263 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bbfdcb07-0adf-4e62-91f0-646fa705c6c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:46.657582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bbfdcb07-0adf-4e62-91f0-646fa705c6c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162397 Jul 04 06:14:46.658142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 905/1822] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:46 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:47.643226 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-847b2079-87d6-4b37-9784-2954e47889da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:47.643885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-847b2079-87d6-4b37-9784-2954e47889da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:47.650889 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-847b2079-87d6-4b37-9784-2954e47889da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:47.651366 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-847b2079-87d6-4b37-9784-2954e47889da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:47.652468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-847b2079-87d6-4b37-9784-2954e47889da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:47.652907 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-847b2079-87d6-4b37-9784-2954e47889da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:47.674100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-85475ea8-9bf1-44c2-a216-a434ee170f53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:47.674804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-85475ea8-9bf1-44c2-a216-a434ee170f53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:47.681593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85475ea8-9bf1-44c2-a216-a434ee170f53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:47.682127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85475ea8-9bf1-44c2-a216-a434ee170f53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:47.682966 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85475ea8-9bf1-44c2-a216-a434ee170f53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:47.683506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85475ea8-9bf1-44c2-a216-a434ee170f53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:47.713556 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-847b2079-87d6-4b37-9784-2954e47889da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:47.722038 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-847b2079-87d6-4b37-9784-2954e47889da tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.082858 Jul 04 06:14:47.722621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 918/1823] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:47.813179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-85475ea8-9bf1-44c2-a216-a434ee170f53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:47.821484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-85475ea8-9bf1-44c2-a216-a434ee170f53 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.151369 Jul 04 06:14:47.822056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 906/1824] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:47 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:48.743041 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7009c178-0378-4e69-84af-2ffb1834a813 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:48.744100 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7009c178-0378-4e69-84af-2ffb1834a813 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:48.755100 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7009c178-0378-4e69-84af-2ffb1834a813 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:48.755898 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7009c178-0378-4e69-84af-2ffb1834a813 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:48.757152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7009c178-0378-4e69-84af-2ffb1834a813 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:48.757890 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7009c178-0378-4e69-84af-2ffb1834a813 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:48.823839 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7009c178-0378-4e69-84af-2ffb1834a813 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:48.833383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7009c178-0378-4e69-84af-2ffb1834a813 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096822 Jul 04 06:14:48.833946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 919/1825] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:48.840851 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-99942e77-e2ea-48ab-b801-0bfef5c8f035 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:48.841469 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-99942e77-e2ea-48ab-b801-0bfef5c8f035 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:48.848624 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99942e77-e2ea-48ab-b801-0bfef5c8f035 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:48.849043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99942e77-e2ea-48ab-b801-0bfef5c8f035 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:48.849803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99942e77-e2ea-48ab-b801-0bfef5c8f035 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:48.850236 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99942e77-e2ea-48ab-b801-0bfef5c8f035 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:48.992601 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99942e77-e2ea-48ab-b801-0bfef5c8f035 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:49.001260 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-99942e77-e2ea-48ab-b801-0bfef5c8f035 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.166498 Jul 04 06:14:49.001841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 907/1826] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:48 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:49.855332 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b1a1988e-36fc-4da7-af16-3a7bed8dfe1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:49.856204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b1a1988e-36fc-4da7-af16-3a7bed8dfe1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:49.867228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1a1988e-36fc-4da7-af16-3a7bed8dfe1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:49.868040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1a1988e-36fc-4da7-af16-3a7bed8dfe1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:49.869311 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1a1988e-36fc-4da7-af16-3a7bed8dfe1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:49.870050 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1a1988e-36fc-4da7-af16-3a7bed8dfe1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:49.936859 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b1a1988e-36fc-4da7-af16-3a7bed8dfe1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:49.946045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b1a1988e-36fc-4da7-af16-3a7bed8dfe1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097425 Jul 04 06:14:49.946621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 920/1827] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:50.022132 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1c30069b-c051-410a-aeb9-2b2cf412b586 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:50.023139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1c30069b-c051-410a-aeb9-2b2cf412b586 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:50.033144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c30069b-c051-410a-aeb9-2b2cf412b586 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:50.033599 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c30069b-c051-410a-aeb9-2b2cf412b586 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:50.034369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c30069b-c051-410a-aeb9-2b2cf412b586 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:50.034802 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c30069b-c051-410a-aeb9-2b2cf412b586 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:50.166056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1c30069b-c051-410a-aeb9-2b2cf412b586 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:50.174736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1c30069b-c051-410a-aeb9-2b2cf412b586 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159139 Jul 04 06:14:50.175297 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 908/1828] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:50 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:50.973045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e9608e3-d362-4444-b011-f10474a0f161 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:50.974091 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7e9608e3-d362-4444-b011-f10474a0f161 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:50.984391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e9608e3-d362-4444-b011-f10474a0f161 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:50.984837 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e9608e3-d362-4444-b011-f10474a0f161 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:50.985602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e9608e3-d362-4444-b011-f10474a0f161 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:50.986036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e9608e3-d362-4444-b011-f10474a0f161 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:51.055675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e9608e3-d362-4444-b011-f10474a0f161 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:51.064228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7e9608e3-d362-4444-b011-f10474a0f161 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098628 Jul 04 06:14:51.064826 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 921/1829] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:50 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:51.196089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a89fc20-096f-4e13-b88e-28c71008854c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:51.197061 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1a89fc20-096f-4e13-b88e-28c71008854c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:51.209272 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a89fc20-096f-4e13-b88e-28c71008854c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:51.210022 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a89fc20-096f-4e13-b88e-28c71008854c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:51.211306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a89fc20-096f-4e13-b88e-28c71008854c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:51.212072 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a89fc20-096f-4e13-b88e-28c71008854c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:51.346975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a89fc20-096f-4e13-b88e-28c71008854c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:51.355588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a89fc20-096f-4e13-b88e-28c71008854c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165969 Jul 04 06:14:51.356167 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 909/1830] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:51 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:52.085711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6ca68e6c-f040-4e36-a464-ff0c99b45bb2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:52.086711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6ca68e6c-f040-4e36-a464-ff0c99b45bb2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:52.096563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ca68e6c-f040-4e36-a464-ff0c99b45bb2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:52.097016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ca68e6c-f040-4e36-a464-ff0c99b45bb2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:52.097785 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ca68e6c-f040-4e36-a464-ff0c99b45bb2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:52.098221 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ca68e6c-f040-4e36-a464-ff0c99b45bb2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:52.160347 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6ca68e6c-f040-4e36-a464-ff0c99b45bb2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:52.168731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6ca68e6c-f040-4e36-a464-ff0c99b45bb2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089668 Jul 04 06:14:52.169309 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 922/1831] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:52 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:52.377117 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-05441ab6-b8b4-46a2-82dc-e6e3786f14b3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:52.378006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-05441ab6-b8b4-46a2-82dc-e6e3786f14b3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:52.388766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05441ab6-b8b4-46a2-82dc-e6e3786f14b3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:52.389503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05441ab6-b8b4-46a2-82dc-e6e3786f14b3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:52.390738 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05441ab6-b8b4-46a2-82dc-e6e3786f14b3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:52.391532 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05441ab6-b8b4-46a2-82dc-e6e3786f14b3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:52.530309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-05441ab6-b8b4-46a2-82dc-e6e3786f14b3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:52.538780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-05441ab6-b8b4-46a2-82dc-e6e3786f14b3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168435 Jul 04 06:14:52.539388 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 910/1832] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:52 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:53.189595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9bad5d1c-976e-40f2-b08d-ed805497cdf2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:53.190645 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9bad5d1c-976e-40f2-b08d-ed805497cdf2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:53.201657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bad5d1c-976e-40f2-b08d-ed805497cdf2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:53.202415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bad5d1c-976e-40f2-b08d-ed805497cdf2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:53.203800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bad5d1c-976e-40f2-b08d-ed805497cdf2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:53.204267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bad5d1c-976e-40f2-b08d-ed805497cdf2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:53.275944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9bad5d1c-976e-40f2-b08d-ed805497cdf2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:53.284519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9bad5d1c-976e-40f2-b08d-ed805497cdf2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.101708 Jul 04 06:14:53.285084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 923/1833] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:53 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:53.558205 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0ecab4a0-b116-4df6-93ba-ac47653b99e5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:53.558848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0ecab4a0-b116-4df6-93ba-ac47653b99e5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:53.567193 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ecab4a0-b116-4df6-93ba-ac47653b99e5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:53.567673 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ecab4a0-b116-4df6-93ba-ac47653b99e5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:53.568433 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ecab4a0-b116-4df6-93ba-ac47653b99e5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:53.568862 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ecab4a0-b116-4df6-93ba-ac47653b99e5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:53.701778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0ecab4a0-b116-4df6-93ba-ac47653b99e5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:53.710362 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0ecab4a0-b116-4df6-93ba-ac47653b99e5 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158271 Jul 04 06:14:53.710901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 911/1834] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:53 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:54.305227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d1b873eb-1bed-4d2e-972d-4c29bf63521d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:54.306219 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d1b873eb-1bed-4d2e-972d-4c29bf63521d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:54.315910 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1b873eb-1bed-4d2e-972d-4c29bf63521d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:54.316354 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1b873eb-1bed-4d2e-972d-4c29bf63521d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:54.317105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1b873eb-1bed-4d2e-972d-4c29bf63521d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:54.317535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1b873eb-1bed-4d2e-972d-4c29bf63521d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:54.388353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d1b873eb-1bed-4d2e-972d-4c29bf63521d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:54.396970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d1b873eb-1bed-4d2e-972d-4c29bf63521d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098279 Jul 04 06:14:54.397563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 924/1835] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:54.730913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8522e939-8681-4aa4-9acd-1cd9f9f4c3ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:54.731976 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8522e939-8681-4aa4-9acd-1cd9f9f4c3ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:54.740071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8522e939-8681-4aa4-9acd-1cd9f9f4c3ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:54.740579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8522e939-8681-4aa4-9acd-1cd9f9f4c3ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:54.741349 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8522e939-8681-4aa4-9acd-1cd9f9f4c3ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:54.741789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8522e939-8681-4aa4-9acd-1cd9f9f4c3ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:54.887288 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8522e939-8681-4aa4-9acd-1cd9f9f4c3ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:54.897116 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8522e939-8681-4aa4-9acd-1cd9f9f4c3ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.172670 Jul 04 06:14:54.897654 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 912/1836] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:54 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:55.418425 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c02ec9ba-d309-4552-bff5-c3f5119976db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:55.419416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c02ec9ba-d309-4552-bff5-c3f5119976db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:55.427580 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c02ec9ba-d309-4552-bff5-c3f5119976db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:55.428033 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c02ec9ba-d309-4552-bff5-c3f5119976db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:55.428800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c02ec9ba-d309-4552-bff5-c3f5119976db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:55.429241 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c02ec9ba-d309-4552-bff5-c3f5119976db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:55.500262 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c02ec9ba-d309-4552-bff5-c3f5119976db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:55.508885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c02ec9ba-d309-4552-bff5-c3f5119976db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096926 Jul 04 06:14:55.509436 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 925/1837] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:55.918979 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4bc7d929-266e-4e4b-b780-5991bc3f66b1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:55.919967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4bc7d929-266e-4e4b-b780-5991bc3f66b1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:55.931125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bc7d929-266e-4e4b-b780-5991bc3f66b1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:55.931919 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bc7d929-266e-4e4b-b780-5991bc3f66b1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:55.933146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bc7d929-266e-4e4b-b780-5991bc3f66b1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:55.933907 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bc7d929-266e-4e4b-b780-5991bc3f66b1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:56.077222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4bc7d929-266e-4e4b-b780-5991bc3f66b1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:56.085942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4bc7d929-266e-4e4b-b780-5991bc3f66b1 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.173538 Jul 04 06:14:56.086514 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 913/1838] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:55 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:56.530072 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d745ba79-eefa-4a34-9669-50bc83ac64fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:56.531083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d745ba79-eefa-4a34-9669-50bc83ac64fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:56.538428 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d745ba79-eefa-4a34-9669-50bc83ac64fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:56.538895 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d745ba79-eefa-4a34-9669-50bc83ac64fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:56.539701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d745ba79-eefa-4a34-9669-50bc83ac64fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:56.540136 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d745ba79-eefa-4a34-9669-50bc83ac64fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:56.610305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d745ba79-eefa-4a34-9669-50bc83ac64fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:56.612589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:14:56.619614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d745ba79-eefa-4a34-9669-50bc83ac64fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096354 Jul 04 06:14:56.620190 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 926/1839] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:56 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:57.107318 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92952d11-c0d2-4359-bdef-c9ee205d0c20 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:57.108191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92952d11-c0d2-4359-bdef-c9ee205d0c20 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:57.115933 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92952d11-c0d2-4359-bdef-c9ee205d0c20 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:57.116386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92952d11-c0d2-4359-bdef-c9ee205d0c20 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:57.117186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92952d11-c0d2-4359-bdef-c9ee205d0c20 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:57.117623 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92952d11-c0d2-4359-bdef-c9ee205d0c20 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:57.251150 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-92952d11-c0d2-4359-bdef-c9ee205d0c20 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:57.259303 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92952d11-c0d2-4359-bdef-c9ee205d0c20 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158638 Jul 04 06:14:57.259904 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 914/1840] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:57 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:57.636857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-86cc9b90-1d6f-4686-a741-5cf42c9f363c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:57.637438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-86cc9b90-1d6f-4686-a741-5cf42c9f363c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:57.644198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86cc9b90-1d6f-4686-a741-5cf42c9f363c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:57.644670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86cc9b90-1d6f-4686-a741-5cf42c9f363c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:57.645400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86cc9b90-1d6f-4686-a741-5cf42c9f363c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:57.645828 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-86cc9b90-1d6f-4686-a741-5cf42c9f363c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:57.718274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-86cc9b90-1d6f-4686-a741-5cf42c9f363c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:57.726780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-86cc9b90-1d6f-4686-a741-5cf42c9f363c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094157 Jul 04 06:14:57.727383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 927/1841] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:57 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:58.281996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e54175ee-f416-4124-ad0e-be01ee117db8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:58.282970 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e54175ee-f416-4124-ad0e-be01ee117db8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:58.293959 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e54175ee-f416-4124-ad0e-be01ee117db8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:58.294597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e54175ee-f416-4124-ad0e-be01ee117db8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:58.297414 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e54175ee-f416-4124-ad0e-be01ee117db8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:58.297414 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e54175ee-f416-4124-ad0e-be01ee117db8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:58.433566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e54175ee-f416-4124-ad0e-be01ee117db8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:58.443509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e54175ee-f416-4124-ad0e-be01ee117db8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168101 Jul 04 06:14:58.444091 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 915/1842] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:58 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:58.745900 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-06586e9c-b7f4-4866-9349-949e4389d27a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:58.746680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-06586e9c-b7f4-4866-9349-949e4389d27a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:58.754638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06586e9c-b7f4-4866-9349-949e4389d27a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:58.755088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06586e9c-b7f4-4866-9349-949e4389d27a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:58.755863 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06586e9c-b7f4-4866-9349-949e4389d27a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:58.756317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06586e9c-b7f4-4866-9349-949e4389d27a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:58.828591 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-06586e9c-b7f4-4866-9349-949e4389d27a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:58.837043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-06586e9c-b7f4-4866-9349-949e4389d27a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096351 Jul 04 06:14:58.837619 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 928/1843] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:59.461679 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2ec3754-b1cc-43fb-98ba-b2be36ebd96e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:59.462261 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f2ec3754-b1cc-43fb-98ba-b2be36ebd96e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:59.468630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2ec3754-b1cc-43fb-98ba-b2be36ebd96e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:59.469070 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2ec3754-b1cc-43fb-98ba-b2be36ebd96e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:59.469867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2ec3754-b1cc-43fb-98ba-b2be36ebd96e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:59.470290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2ec3754-b1cc-43fb-98ba-b2be36ebd96e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:59.605712 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2ec3754-b1cc-43fb-98ba-b2be36ebd96e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:59.617850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f2ec3754-b1cc-43fb-98ba-b2be36ebd96e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159856 Jul 04 06:14:59.618579 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 916/1844] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:59 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:14:59.856099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ca8245d1-705a-49c2-bd3c-acbf0e9649fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:14:59.856970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ca8245d1-705a-49c2-bd3c-acbf0e9649fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:14:59.864828 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca8245d1-705a-49c2-bd3c-acbf0e9649fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:59.865278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca8245d1-705a-49c2-bd3c-acbf0e9649fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:59.866045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca8245d1-705a-49c2-bd3c-acbf0e9649fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:14:59.866482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca8245d1-705a-49c2-bd3c-acbf0e9649fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:14:59.927786 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca8245d1-705a-49c2-bd3c-acbf0e9649fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:14:59.935848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ca8245d1-705a-49c2-bd3c-acbf0e9649fc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085087 Jul 04 06:14:59.936420 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 929/1845] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:14:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:00.636288 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1063c313-0658-4144-8ab6-a95bf58c2769 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:00.636834 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1063c313-0658-4144-8ab6-a95bf58c2769 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:00.644138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1063c313-0658-4144-8ab6-a95bf58c2769 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:00.644589 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1063c313-0658-4144-8ab6-a95bf58c2769 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:00.645354 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1063c313-0658-4144-8ab6-a95bf58c2769 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:00.645790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1063c313-0658-4144-8ab6-a95bf58c2769 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:00.782885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1063c313-0658-4144-8ab6-a95bf58c2769 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:00.795025 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1063c313-0658-4144-8ab6-a95bf58c2769 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162379 Jul 04 06:15:00.795983 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 917/1846] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:00 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:00.952751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fd48814e-819f-4c5f-93e4-e2ae4bac7994 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:00.953456 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fd48814e-819f-4c5f-93e4-e2ae4bac7994 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:00.960822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd48814e-819f-4c5f-93e4-e2ae4bac7994 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:00.961276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd48814e-819f-4c5f-93e4-e2ae4bac7994 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:00.962050 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd48814e-819f-4c5f-93e4-e2ae4bac7994 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:00.962491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd48814e-819f-4c5f-93e4-e2ae4bac7994 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:01.039088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fd48814e-819f-4c5f-93e4-e2ae4bac7994 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:01.047930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fd48814e-819f-4c5f-93e4-e2ae4bac7994 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.099118 Jul 04 06:15:01.048512 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 930/1847] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:00 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:01.813229 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a8c56316-9ea9-4928-9feb-98b3d8911efb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:01.813794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a8c56316-9ea9-4928-9feb-98b3d8911efb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:01.820520 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c56316-9ea9-4928-9feb-98b3d8911efb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:01.821002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c56316-9ea9-4928-9feb-98b3d8911efb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:01.821765 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c56316-9ea9-4928-9feb-98b3d8911efb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:01.822200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c56316-9ea9-4928-9feb-98b3d8911efb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:01.956109 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a8c56316-9ea9-4928-9feb-98b3d8911efb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:01.964177 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a8c56316-9ea9-4928-9feb-98b3d8911efb tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.155115 Jul 04 06:15:01.964769 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 918/1848] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:01 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:02.069111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ff8f408d-17c8-4a14-aa41-a24ab56e1895 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:02.069968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ff8f408d-17c8-4a14-aa41-a24ab56e1895 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:02.080617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff8f408d-17c8-4a14-aa41-a24ab56e1895 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:02.081073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff8f408d-17c8-4a14-aa41-a24ab56e1895 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:02.081839 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff8f408d-17c8-4a14-aa41-a24ab56e1895 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:02.082276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff8f408d-17c8-4a14-aa41-a24ab56e1895 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:02.144443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ff8f408d-17c8-4a14-aa41-a24ab56e1895 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:02.156109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ff8f408d-17c8-4a14-aa41-a24ab56e1895 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093720 Jul 04 06:15:02.156853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 931/1849] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:02 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:02.985948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d2947666-a29c-4c0c-8f61-7df736354f2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:02.986662 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d2947666-a29c-4c0c-8f61-7df736354f2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:02.994952 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2947666-a29c-4c0c-8f61-7df736354f2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:02.995517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2947666-a29c-4c0c-8f61-7df736354f2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:02.996417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2947666-a29c-4c0c-8f61-7df736354f2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:02.996928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2947666-a29c-4c0c-8f61-7df736354f2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:03.132079 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2947666-a29c-4c0c-8f61-7df736354f2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:03.141440 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d2947666-a29c-4c0c-8f61-7df736354f2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162165 Jul 04 06:15:03.148826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 919/1850] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:02 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:03.173351 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b57eda98-e177-4679-a631-5ffefda2aefd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:03.173986 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b57eda98-e177-4679-a631-5ffefda2aefd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:03.180687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b57eda98-e177-4679-a631-5ffefda2aefd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:03.181149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b57eda98-e177-4679-a631-5ffefda2aefd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:03.181911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b57eda98-e177-4679-a631-5ffefda2aefd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:03.182346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b57eda98-e177-4679-a631-5ffefda2aefd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:03.250596 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b57eda98-e177-4679-a631-5ffefda2aefd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:03.259519 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b57eda98-e177-4679-a631-5ffefda2aefd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090218 Jul 04 06:15:03.260103 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 932/1851] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:04.162770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2d486ab-b50a-45f0-9b41-3fdf7ed7ce5c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:04.163874 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c2d486ab-b50a-45f0-9b41-3fdf7ed7ce5c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:04.175120 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2d486ab-b50a-45f0-9b41-3fdf7ed7ce5c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:04.175929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2d486ab-b50a-45f0-9b41-3fdf7ed7ce5c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:04.177206 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2d486ab-b50a-45f0-9b41-3fdf7ed7ce5c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:04.177934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2d486ab-b50a-45f0-9b41-3fdf7ed7ce5c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:04.276288 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a69d41a2-d7c8-4e98-848f-1eab6c7acb3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:04.277227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a69d41a2-d7c8-4e98-848f-1eab6c7acb3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:04.283847 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a69d41a2-d7c8-4e98-848f-1eab6c7acb3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:04.284271 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a69d41a2-d7c8-4e98-848f-1eab6c7acb3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:04.285039 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a69d41a2-d7c8-4e98-848f-1eab6c7acb3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:04.285497 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a69d41a2-d7c8-4e98-848f-1eab6c7acb3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:04.316680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c2d486ab-b50a-45f0-9b41-3fdf7ed7ce5c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:04.325043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2d486ab-b50a-45f0-9b41-3fdf7ed7ce5c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169068 Jul 04 06:15:04.325619 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 920/1852] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:04 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:04.346571 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a69d41a2-d7c8-4e98-848f-1eab6c7acb3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:04.354700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a69d41a2-d7c8-4e98-848f-1eab6c7acb3d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.082261 Jul 04 06:15:04.355271 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 933/1853] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:15:05.346246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d4e97fcb-5a65-43f3-9e75-5a366dd05f2f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:05.347289 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d4e97fcb-5a65-43f3-9e75-5a366dd05f2f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:05.358126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4e97fcb-5a65-43f3-9e75-5a366dd05f2f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:05.358879 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4e97fcb-5a65-43f3-9e75-5a366dd05f2f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:05.360103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4e97fcb-5a65-43f3-9e75-5a366dd05f2f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:05.360540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4e97fcb-5a65-43f3-9e75-5a366dd05f2f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:05.371406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ffd60da6-5a5a-4bb6-8505-f4b53eb4e653 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:05.372035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ffd60da6-5a5a-4bb6-8505-f4b53eb4e653 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:05.379033 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffd60da6-5a5a-4bb6-8505-f4b53eb4e653 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:05.379544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffd60da6-5a5a-4bb6-8505-f4b53eb4e653 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:05.380320 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffd60da6-5a5a-4bb6-8505-f4b53eb4e653 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:05.380757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffd60da6-5a5a-4bb6-8505-f4b53eb4e653 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:05.444128 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ffd60da6-5a5a-4bb6-8505-f4b53eb4e653 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:05.452469 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ffd60da6-5a5a-4bb6-8505-f4b53eb4e653 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.084967 Jul 04 06:15:05.453060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 934/1854] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:05 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:05.732030 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d4e97fcb-5a65-43f3-9e75-5a366dd05f2f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:05.735472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:15:05.746429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d4e97fcb-5a65-43f3-9e75-5a366dd05f2f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.406477 Jul 04 06:15:05.747366 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 921/1855] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:05 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:06.473548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-feff8c83-b2a7-4095-bbbd-bd3ba1ad3417 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:06.474508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-feff8c83-b2a7-4095-bbbd-bd3ba1ad3417 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:06.485557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feff8c83-b2a7-4095-bbbd-bd3ba1ad3417 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:06.486292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feff8c83-b2a7-4095-bbbd-bd3ba1ad3417 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:06.487616 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feff8c83-b2a7-4095-bbbd-bd3ba1ad3417 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:06.488328 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feff8c83-b2a7-4095-bbbd-bd3ba1ad3417 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:06.557120 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-feff8c83-b2a7-4095-bbbd-bd3ba1ad3417 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:06.571086 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-feff8c83-b2a7-4095-bbbd-bd3ba1ad3417 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.103919 Jul 04 06:15:06.572506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 935/1856] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:06.769089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a9f5653-ebad-40e8-b837-861c765ebde4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:06.770094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a9f5653-ebad-40e8-b837-861c765ebde4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:06.773715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:15:06.783135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a9f5653-ebad-40e8-b837-861c765ebde4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:06.783932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a9f5653-ebad-40e8-b837-861c765ebde4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:06.785207 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a9f5653-ebad-40e8-b837-861c765ebde4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:06.785976 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a9f5653-ebad-40e8-b837-861c765ebde4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:06.920992 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a9f5653-ebad-40e8-b837-861c765ebde4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:06.929550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a9f5653-ebad-40e8-b837-861c765ebde4 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167569 Jul 04 06:15:06.930090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 922/1857] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:06 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:07.588623 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-81c5411d-bb9d-41ce-8550-f175dbb3df25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:07.589340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-81c5411d-bb9d-41ce-8550-f175dbb3df25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:07.595978 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81c5411d-bb9d-41ce-8550-f175dbb3df25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:07.596430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81c5411d-bb9d-41ce-8550-f175dbb3df25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:07.597191 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81c5411d-bb9d-41ce-8550-f175dbb3df25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:07.597623 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81c5411d-bb9d-41ce-8550-f175dbb3df25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:07.665508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-81c5411d-bb9d-41ce-8550-f175dbb3df25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:07.677808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-81c5411d-bb9d-41ce-8550-f175dbb3df25 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092412 Jul 04 06:15:07.677808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 936/1858] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:07.950905 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b765e7dc-8597-47e5-acaf-ef565e9657b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:07.951871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b765e7dc-8597-47e5-acaf-ef565e9657b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:07.962545 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b765e7dc-8597-47e5-acaf-ef565e9657b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:07.963315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b765e7dc-8597-47e5-acaf-ef565e9657b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:07.964607 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b765e7dc-8597-47e5-acaf-ef565e9657b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:07.965338 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b765e7dc-8597-47e5-acaf-ef565e9657b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:08.101530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b765e7dc-8597-47e5-acaf-ef565e9657b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:08.112600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b765e7dc-8597-47e5-acaf-ef565e9657b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168574 Jul 04 06:15:08.113238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 923/1859] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:07 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:08.701116 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2a8d776b-415d-4297-ba27-3b5885e10663 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:08.702122 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2a8d776b-415d-4297-ba27-3b5885e10663 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:08.705720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:15:08.714390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a8d776b-415d-4297-ba27-3b5885e10663 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:08.715150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a8d776b-415d-4297-ba27-3b5885e10663 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:08.716440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a8d776b-415d-4297-ba27-3b5885e10663 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:08.717152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a8d776b-415d-4297-ba27-3b5885e10663 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:08.790144 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2a8d776b-415d-4297-ba27-3b5885e10663 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:08.798801 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2a8d776b-415d-4297-ba27-3b5885e10663 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.104231 Jul 04 06:15:08.799372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 937/1860] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:08 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:09.134446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-68f6155e-f363-40bd-be1a-9ed4037829de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:09.135425 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-68f6155e-f363-40bd-be1a-9ed4037829de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:09.146194 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68f6155e-f363-40bd-be1a-9ed4037829de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:09.146941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68f6155e-f363-40bd-be1a-9ed4037829de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:09.148255 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68f6155e-f363-40bd-be1a-9ed4037829de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:09.148973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68f6155e-f363-40bd-be1a-9ed4037829de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:09.282731 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-68f6155e-f363-40bd-be1a-9ed4037829de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:09.291270 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-68f6155e-f363-40bd-be1a-9ed4037829de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163376 Jul 04 06:15:09.291852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 924/1861] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:09 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:09.819473 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-32d57462-e89c-4d56-80bd-ee5f60cc5f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:09.820132 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-32d57462-e89c-4d56-80bd-ee5f60cc5f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:09.827467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32d57462-e89c-4d56-80bd-ee5f60cc5f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:09.828010 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32d57462-e89c-4d56-80bd-ee5f60cc5f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:09.828905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32d57462-e89c-4d56-80bd-ee5f60cc5f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:09.829553 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32d57462-e89c-4d56-80bd-ee5f60cc5f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:09.892555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-32d57462-e89c-4d56-80bd-ee5f60cc5f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:09.904926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-32d57462-e89c-4d56-80bd-ee5f60cc5f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091361 Jul 04 06:15:09.905701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 938/1862] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:10.312037 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-35f5b508-04c7-4bc6-b884-8713ee27c991 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:10.312976 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-35f5b508-04c7-4bc6-b884-8713ee27c991 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:10.323951 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35f5b508-04c7-4bc6-b884-8713ee27c991 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:10.324708 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35f5b508-04c7-4bc6-b884-8713ee27c991 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:10.326039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35f5b508-04c7-4bc6-b884-8713ee27c991 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:10.326768 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35f5b508-04c7-4bc6-b884-8713ee27c991 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:10.472021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35f5b508-04c7-4bc6-b884-8713ee27c991 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:10.480550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-35f5b508-04c7-4bc6-b884-8713ee27c991 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.175065 Jul 04 06:15:10.481090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 925/1863] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:10 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:10.922452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-58c4d594-9b23-4778-b1f0-86e2541a069d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:10.923042 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-58c4d594-9b23-4778-b1f0-86e2541a069d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:10.929674 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58c4d594-9b23-4778-b1f0-86e2541a069d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:10.930124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58c4d594-9b23-4778-b1f0-86e2541a069d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:10.930884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58c4d594-9b23-4778-b1f0-86e2541a069d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:10.931360 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58c4d594-9b23-4778-b1f0-86e2541a069d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:10.995419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-58c4d594-9b23-4778-b1f0-86e2541a069d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:11.004190 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-58c4d594-9b23-4778-b1f0-86e2541a069d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085726 Jul 04 06:15:11.004765 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 939/1864] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:10 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:11.500123 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-64737006-4be0-4392-a890-908cd3579e77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:11.500873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-64737006-4be0-4392-a890-908cd3579e77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:11.508290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64737006-4be0-4392-a890-908cd3579e77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:11.508729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64737006-4be0-4392-a890-908cd3579e77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:11.509510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64737006-4be0-4392-a890-908cd3579e77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:11.509939 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64737006-4be0-4392-a890-908cd3579e77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:11.643493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-64737006-4be0-4392-a890-908cd3579e77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:11.652027 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-64737006-4be0-4392-a890-908cd3579e77 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156430 Jul 04 06:15:11.652598 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 926/1865] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:11 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:12.029196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8125ea3b-f8cd-411d-9a0b-122744deb84f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:12.030162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8125ea3b-f8cd-411d-9a0b-122744deb84f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:12.041209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8125ea3b-f8cd-411d-9a0b-122744deb84f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:12.041957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8125ea3b-f8cd-411d-9a0b-122744deb84f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:12.043295 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8125ea3b-f8cd-411d-9a0b-122744deb84f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:12.044087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8125ea3b-f8cd-411d-9a0b-122744deb84f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:12.110039 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8125ea3b-f8cd-411d-9a0b-122744deb84f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:12.118513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8125ea3b-f8cd-411d-9a0b-122744deb84f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096323 Jul 04 06:15:12.119094 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 940/1866] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:12 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:12.674993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3bad4fa7-88f6-4034-8425-7f9538638a60 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:12.675705 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3bad4fa7-88f6-4034-8425-7f9538638a60 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:12.683060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bad4fa7-88f6-4034-8425-7f9538638a60 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:12.683584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bad4fa7-88f6-4034-8425-7f9538638a60 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:12.684422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bad4fa7-88f6-4034-8425-7f9538638a60 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:12.684893 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bad4fa7-88f6-4034-8425-7f9538638a60 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:12.820104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3bad4fa7-88f6-4034-8425-7f9538638a60 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:12.827988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3bad4fa7-88f6-4034-8425-7f9538638a60 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159295 Jul 04 06:15:12.828578 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 927/1867] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:12 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:13.135525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d2724fad-d196-48c9-9178-419ac5175a71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:13.136311 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d2724fad-d196-48c9-9178-419ac5175a71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:13.143159 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2724fad-d196-48c9-9178-419ac5175a71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:13.143642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2724fad-d196-48c9-9178-419ac5175a71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:13.144413 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2724fad-d196-48c9-9178-419ac5175a71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:13.144885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2724fad-d196-48c9-9178-419ac5175a71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:13.207675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d2724fad-d196-48c9-9178-419ac5175a71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:13.216090 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d2724fad-d196-48c9-9178-419ac5175a71 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.084649 Jul 04 06:15:13.216663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 941/1868] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:13 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:13.849932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-10669fc7-2b77-443f-a05a-4a5b0c302aea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:13.850829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-10669fc7-2b77-443f-a05a-4a5b0c302aea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:13.861913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10669fc7-2b77-443f-a05a-4a5b0c302aea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:13.862682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10669fc7-2b77-443f-a05a-4a5b0c302aea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:13.863990 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10669fc7-2b77-443f-a05a-4a5b0c302aea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:13.864716 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10669fc7-2b77-443f-a05a-4a5b0c302aea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:14.004433 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-10669fc7-2b77-443f-a05a-4a5b0c302aea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:14.013140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-10669fc7-2b77-443f-a05a-4a5b0c302aea tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169986 Jul 04 06:15:14.013693 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 928/1869] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:13 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:14.237603 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-23068200-3ca7-4291-8192-f056423b9dd6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:14.238396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-23068200-3ca7-4291-8192-f056423b9dd6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:14.247064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23068200-3ca7-4291-8192-f056423b9dd6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:14.247675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23068200-3ca7-4291-8192-f056423b9dd6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:14.248624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23068200-3ca7-4291-8192-f056423b9dd6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:14.249173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23068200-3ca7-4291-8192-f056423b9dd6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:14.315829 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-23068200-3ca7-4291-8192-f056423b9dd6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:14.324435 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-23068200-3ca7-4291-8192-f056423b9dd6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092903 Jul 04 06:15:14.325002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 942/1870] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:14 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:15.033323 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e4e650f-6440-4ee1-8e7a-ccb98e9073c2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:15.034100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9e4e650f-6440-4ee1-8e7a-ccb98e9073c2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:15.043189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e4e650f-6440-4ee1-8e7a-ccb98e9073c2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:15.043977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e4e650f-6440-4ee1-8e7a-ccb98e9073c2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:15.044987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e4e650f-6440-4ee1-8e7a-ccb98e9073c2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:15.045557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e4e650f-6440-4ee1-8e7a-ccb98e9073c2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:15.180046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9e4e650f-6440-4ee1-8e7a-ccb98e9073c2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:15.188785 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e4e650f-6440-4ee1-8e7a-ccb98e9073c2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.160562 Jul 04 06:15:15.189268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 929/1871] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:15 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:15.345464 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-318ac297-7562-423d-a357-0a462b01338b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:15.346067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-318ac297-7562-423d-a357-0a462b01338b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:15.353577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-318ac297-7562-423d-a357-0a462b01338b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:15.354056 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-318ac297-7562-423d-a357-0a462b01338b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:15.354865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-318ac297-7562-423d-a357-0a462b01338b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:15.355365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-318ac297-7562-423d-a357-0a462b01338b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:15.371375 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:15:15.422468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-318ac297-7562-423d-a357-0a462b01338b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:15.430600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-318ac297-7562-423d-a357-0a462b01338b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091722 Jul 04 06:15:15.431173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 943/1872] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:16.210450 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8849492d-76fa-4d73-ae7d-942050665822 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:16.211442 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8849492d-76fa-4d73-ae7d-942050665822 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:16.221537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8849492d-76fa-4d73-ae7d-942050665822 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:16.221983 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8849492d-76fa-4d73-ae7d-942050665822 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:16.222734 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8849492d-76fa-4d73-ae7d-942050665822 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:16.223162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8849492d-76fa-4d73-ae7d-942050665822 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:16.369965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8849492d-76fa-4d73-ae7d-942050665822 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:16.382334 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8849492d-76fa-4d73-ae7d-942050665822 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.178092 Jul 04 06:15:16.383157 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 930/1873] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:16 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:16.449058 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-af755a7f-beb9-4a05-9373-2ea5691d275f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:16.449911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-af755a7f-beb9-4a05-9373-2ea5691d275f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:16.457919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af755a7f-beb9-4a05-9373-2ea5691d275f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:16.458372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af755a7f-beb9-4a05-9373-2ea5691d275f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:16.459151 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af755a7f-beb9-4a05-9373-2ea5691d275f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:16.459624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af755a7f-beb9-4a05-9373-2ea5691d275f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:16.528080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-af755a7f-beb9-4a05-9373-2ea5691d275f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:16.536560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-af755a7f-beb9-4a05-9373-2ea5691d275f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092667 Jul 04 06:15:16.537107 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 944/1874] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:17.406956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb0c7981-17f1-4ed9-981f-abc1b4c9c1ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:17.407920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb0c7981-17f1-4ed9-981f-abc1b4c9c1ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:17.415052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb0c7981-17f1-4ed9-981f-abc1b4c9c1ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:17.415535 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb0c7981-17f1-4ed9-981f-abc1b4c9c1ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:17.416301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb0c7981-17f1-4ed9-981f-abc1b4c9c1ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:17.416740 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb0c7981-17f1-4ed9-981f-abc1b4c9c1ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:17.551238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb0c7981-17f1-4ed9-981f-abc1b4c9c1ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:17.553286 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7fbc08ea-62a9-4aba-a1ed-479f462077a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:17.553894 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7fbc08ea-62a9-4aba-a1ed-479f462077a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:17.559668 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb0c7981-17f1-4ed9-981f-abc1b4c9c1ad tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159288 Jul 04 06:15:17.560244 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 931/1875] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:17 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:17.560811 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fbc08ea-62a9-4aba-a1ed-479f462077a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:17.561339 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fbc08ea-62a9-4aba-a1ed-479f462077a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:17.562127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fbc08ea-62a9-4aba-a1ed-479f462077a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:17.562567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fbc08ea-62a9-4aba-a1ed-479f462077a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:17.626443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7fbc08ea-62a9-4aba-a1ed-479f462077a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:17.634822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7fbc08ea-62a9-4aba-a1ed-479f462077a2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085398 Jul 04 06:15:17.635421 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 945/1876] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:18.579750 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8590dde-c11c-47d0-a54a-20703fa3e728 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:18.580610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8590dde-c11c-47d0-a54a-20703fa3e728 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:18.588174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8590dde-c11c-47d0-a54a-20703fa3e728 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:18.588648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8590dde-c11c-47d0-a54a-20703fa3e728 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:18.589453 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8590dde-c11c-47d0-a54a-20703fa3e728 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:18.589921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8590dde-c11c-47d0-a54a-20703fa3e728 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:18.650915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-338b6e11-e99d-4089-bfd6-aee7235aae8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:18.651906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-338b6e11-e99d-4089-bfd6-aee7235aae8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:18.658580 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-338b6e11-e99d-4089-bfd6-aee7235aae8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:18.659061 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-338b6e11-e99d-4089-bfd6-aee7235aae8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:18.660062 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-338b6e11-e99d-4089-bfd6-aee7235aae8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:18.660584 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-338b6e11-e99d-4089-bfd6-aee7235aae8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:18.729060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8590dde-c11c-47d0-a54a-20703fa3e728 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:18.733595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-338b6e11-e99d-4089-bfd6-aee7235aae8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:18.737673 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8590dde-c11c-47d0-a54a-20703fa3e728 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163442 Jul 04 06:15:18.738367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 932/1877] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:18 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:18.741973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-338b6e11-e99d-4089-bfd6-aee7235aae8d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095106 Jul 04 06:15:18.742580 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 946/1878] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:19.759405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ec6ce892-97e1-4448-b00d-20a42ee37517 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:19.760328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ec6ce892-97e1-4448-b00d-20a42ee37517 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:19.761773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8b2c79fd-c5cb-4c2d-b6d2-af3926e6ad70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:19.762782 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8b2c79fd-c5cb-4c2d-b6d2-af3926e6ad70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:19.771960 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec6ce892-97e1-4448-b00d-20a42ee37517 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:19.773070 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec6ce892-97e1-4448-b00d-20a42ee37517 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:19.773887 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b2c79fd-c5cb-4c2d-b6d2-af3926e6ad70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:19.774545 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec6ce892-97e1-4448-b00d-20a42ee37517 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:19.774798 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b2c79fd-c5cb-4c2d-b6d2-af3926e6ad70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:19.775297 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec6ce892-97e1-4448-b00d-20a42ee37517 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:19.775924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b2c79fd-c5cb-4c2d-b6d2-af3926e6ad70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:19.777019 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b2c79fd-c5cb-4c2d-b6d2-af3926e6ad70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:19.842340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8b2c79fd-c5cb-4c2d-b6d2-af3926e6ad70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:19.850501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8b2c79fd-c5cb-4c2d-b6d2-af3926e6ad70 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095273 Jul 04 06:15:19.851236 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 947/1879] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:19.917114 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ec6ce892-97e1-4448-b00d-20a42ee37517 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:19.928426 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ec6ce892-97e1-4448-b00d-20a42ee37517 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.175638 Jul 04 06:15:19.928973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 933/1880] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:19 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:20.872031 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4dc9da61-6281-4f66-af18-cfa0d870acc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:20.872941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4dc9da61-6281-4f66-af18-cfa0d870acc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:20.883942 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4dc9da61-6281-4f66-af18-cfa0d870acc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:20.884678 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4dc9da61-6281-4f66-af18-cfa0d870acc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:20.886101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4dc9da61-6281-4f66-af18-cfa0d870acc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:20.887121 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4dc9da61-6281-4f66-af18-cfa0d870acc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:20.951645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0b1825c5-383d-4c70-87ff-959b0a38db3c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:20.952280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0b1825c5-383d-4c70-87ff-959b0a38db3c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:20.956211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4dc9da61-6281-4f66-af18-cfa0d870acc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:20.958885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b1825c5-383d-4c70-87ff-959b0a38db3c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:20.959336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b1825c5-383d-4c70-87ff-959b0a38db3c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:20.960111 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b1825c5-383d-4c70-87ff-959b0a38db3c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:20.960544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b1825c5-383d-4c70-87ff-959b0a38db3c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:20.964495 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4dc9da61-6281-4f66-af18-cfa0d870acc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.099262 Jul 04 06:15:20.965073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 948/1881] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:20 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:21.097435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0b1825c5-383d-4c70-87ff-959b0a38db3c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:21.108166 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0b1825c5-383d-4c70-87ff-959b0a38db3c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.160204 Jul 04 06:15:21.109014 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 934/1882] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:20 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:15:21.985482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0ae7d0c2-1dfd-46b7-9b32-b5dd86e1a20f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:21.986515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0ae7d0c2-1dfd-46b7-9b32-b5dd86e1a20f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:21.997668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ae7d0c2-1dfd-46b7-9b32-b5dd86e1a20f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:21.998422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ae7d0c2-1dfd-46b7-9b32-b5dd86e1a20f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:21.999742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ae7d0c2-1dfd-46b7-9b32-b5dd86e1a20f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:22.000518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ae7d0c2-1dfd-46b7-9b32-b5dd86e1a20f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:22.068050 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0ae7d0c2-1dfd-46b7-9b32-b5dd86e1a20f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:22.076646 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0ae7d0c2-1dfd-46b7-9b32-b5dd86e1a20f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097840 Jul 04 06:15:22.077199 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 949/1883] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:22.126175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cf5035a2-8aba-4e00-8876-bb1899e54465 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:22.126821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cf5035a2-8aba-4e00-8876-bb1899e54465 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:22.134978 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf5035a2-8aba-4e00-8876-bb1899e54465 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:22.135385 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf5035a2-8aba-4e00-8876-bb1899e54465 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:22.136178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf5035a2-8aba-4e00-8876-bb1899e54465 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:22.136629 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf5035a2-8aba-4e00-8876-bb1899e54465 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:22.275022 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cf5035a2-8aba-4e00-8876-bb1899e54465 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:22.283476 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cf5035a2-8aba-4e00-8876-bb1899e54465 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.161224 Jul 04 06:15:22.284052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 935/1884] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:22 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:23.098092 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-606a2b79-bb25-487d-888a-edb9f5ba2d5b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:23.099026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-606a2b79-bb25-487d-888a-edb9f5ba2d5b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:23.110015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606a2b79-bb25-487d-888a-edb9f5ba2d5b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:23.110772 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606a2b79-bb25-487d-888a-edb9f5ba2d5b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:23.112102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606a2b79-bb25-487d-888a-edb9f5ba2d5b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:23.112832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606a2b79-bb25-487d-888a-edb9f5ba2d5b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:23.186667 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-606a2b79-bb25-487d-888a-edb9f5ba2d5b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:23.194865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-606a2b79-bb25-487d-888a-edb9f5ba2d5b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.103400 Jul 04 06:15:23.195463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 950/1885] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:23.304585 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cc98298c-dfae-46d1-b84f-1d5d30a47785 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:23.305549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cc98298c-dfae-46d1-b84f-1d5d30a47785 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:23.316836 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc98298c-dfae-46d1-b84f-1d5d30a47785 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:23.317640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc98298c-dfae-46d1-b84f-1d5d30a47785 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:23.318400 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc98298c-dfae-46d1-b84f-1d5d30a47785 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:23.318834 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc98298c-dfae-46d1-b84f-1d5d30a47785 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:23.460506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cc98298c-dfae-46d1-b84f-1d5d30a47785 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:23.473506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cc98298c-dfae-46d1-b84f-1d5d30a47785 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.175593 Jul 04 06:15:23.474218 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 936/1886] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:23 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:24.212001 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6ebd7fbf-863a-4105-a62c-493e4e9a9622 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:24.212902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6ebd7fbf-863a-4105-a62c-493e4e9a9622 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:24.220095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ebd7fbf-863a-4105-a62c-493e4e9a9622 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:24.220470 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ebd7fbf-863a-4105-a62c-493e4e9a9622 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:24.221248 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ebd7fbf-863a-4105-a62c-493e4e9a9622 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:24.221685 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ebd7fbf-863a-4105-a62c-493e4e9a9622 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:24.296967 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6ebd7fbf-863a-4105-a62c-493e4e9a9622 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:24.305149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6ebd7fbf-863a-4105-a62c-493e4e9a9622 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097046 Jul 04 06:15:24.305727 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 951/1887] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:24.496148 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8b14a2e6-3922-4de0-a705-aa1ebaa06bfa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:24.496752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8b14a2e6-3922-4de0-a705-aa1ebaa06bfa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:24.503725 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b14a2e6-3922-4de0-a705-aa1ebaa06bfa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:24.504168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b14a2e6-3922-4de0-a705-aa1ebaa06bfa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:24.504931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b14a2e6-3922-4de0-a705-aa1ebaa06bfa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:24.505390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b14a2e6-3922-4de0-a705-aa1ebaa06bfa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:24.644446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8b14a2e6-3922-4de0-a705-aa1ebaa06bfa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:24.653050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8b14a2e6-3922-4de0-a705-aa1ebaa06bfa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.160890 Jul 04 06:15:24.653613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 937/1888] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:24 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:25.326157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c7597891-0339-4bd8-886f-a4404cc71e08 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:25.327129 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c7597891-0339-4bd8-886f-a4404cc71e08 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:25.336416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7597891-0339-4bd8-886f-a4404cc71e08 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:25.336855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7597891-0339-4bd8-886f-a4404cc71e08 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:25.337614 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7597891-0339-4bd8-886f-a4404cc71e08 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:25.338040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7597891-0339-4bd8-886f-a4404cc71e08 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:25.404854 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c7597891-0339-4bd8-886f-a4404cc71e08 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:25.417691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c7597891-0339-4bd8-886f-a4404cc71e08 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097985 Jul 04 06:15:25.418525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 952/1889] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:25.673424 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-af0e2225-7d8f-41b3-8b1d-320566056caa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:25.674294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-af0e2225-7d8f-41b3-8b1d-320566056caa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:25.685228 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af0e2225-7d8f-41b3-8b1d-320566056caa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:25.685994 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af0e2225-7d8f-41b3-8b1d-320566056caa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:25.687278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af0e2225-7d8f-41b3-8b1d-320566056caa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:25.688034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af0e2225-7d8f-41b3-8b1d-320566056caa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:25.704721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:15:25.826273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-af0e2225-7d8f-41b3-8b1d-320566056caa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:25.838987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-af0e2225-7d8f-41b3-8b1d-320566056caa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.171753 Jul 04 06:15:25.839760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 938/1890] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:25 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:26.441718 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cb9cc7b6-2f5a-41ed-887e-e6bb065f0b80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:26.442755 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cb9cc7b6-2f5a-41ed-887e-e6bb065f0b80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:26.449967 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb9cc7b6-2f5a-41ed-887e-e6bb065f0b80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:26.450442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb9cc7b6-2f5a-41ed-887e-e6bb065f0b80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:26.451277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb9cc7b6-2f5a-41ed-887e-e6bb065f0b80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:26.451743 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb9cc7b6-2f5a-41ed-887e-e6bb065f0b80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:26.524818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cb9cc7b6-2f5a-41ed-887e-e6bb065f0b80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:26.533931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cb9cc7b6-2f5a-41ed-887e-e6bb065f0b80 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098932 Jul 04 06:15:26.534541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 953/1891] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:26.860715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8cd5624f-6466-4da2-93c4-645f33e18998 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:26.861615 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8cd5624f-6466-4da2-93c4-645f33e18998 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:26.869681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cd5624f-6466-4da2-93c4-645f33e18998 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:26.870131 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cd5624f-6466-4da2-93c4-645f33e18998 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:26.870901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cd5624f-6466-4da2-93c4-645f33e18998 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:26.871369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cd5624f-6466-4da2-93c4-645f33e18998 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:27.011519 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8cd5624f-6466-4da2-93c4-645f33e18998 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:27.024082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8cd5624f-6466-4da2-93c4-645f33e18998 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169965 Jul 04 06:15:27.024807 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 939/1892] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:26 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:27.552810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-070dc2ee-5c07-4f89-8ba4-de61d15caae8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:27.553429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-070dc2ee-5c07-4f89-8ba4-de61d15caae8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:27.560589 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-070dc2ee-5c07-4f89-8ba4-de61d15caae8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:27.561041 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-070dc2ee-5c07-4f89-8ba4-de61d15caae8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:27.561812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-070dc2ee-5c07-4f89-8ba4-de61d15caae8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:27.562247 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-070dc2ee-5c07-4f89-8ba4-de61d15caae8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:27.626336 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-070dc2ee-5c07-4f89-8ba4-de61d15caae8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:27.634782 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-070dc2ee-5c07-4f89-8ba4-de61d15caae8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085950 Jul 04 06:15:27.635391 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 954/1893] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:28.047106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b0fe34ec-e87c-42e1-a0b5-4971a2e29d56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:28.048357 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b0fe34ec-e87c-42e1-a0b5-4971a2e29d56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:28.056038 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0fe34ec-e87c-42e1-a0b5-4971a2e29d56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:28.056576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0fe34ec-e87c-42e1-a0b5-4971a2e29d56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:28.057487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0fe34ec-e87c-42e1-a0b5-4971a2e29d56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:28.058005 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0fe34ec-e87c-42e1-a0b5-4971a2e29d56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:28.197432 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b0fe34ec-e87c-42e1-a0b5-4971a2e29d56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:28.205980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b0fe34ec-e87c-42e1-a0b5-4971a2e29d56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164180 Jul 04 06:15:28.206586 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 940/1894] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:28 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:28.655167 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-da01aa23-43c6-4caf-8298-50c57a468305 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:28.655826 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-da01aa23-43c6-4caf-8298-50c57a468305 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:28.662771 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da01aa23-43c6-4caf-8298-50c57a468305 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:28.663230 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da01aa23-43c6-4caf-8298-50c57a468305 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:28.664030 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da01aa23-43c6-4caf-8298-50c57a468305 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:28.664467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da01aa23-43c6-4caf-8298-50c57a468305 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:28.726330 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-da01aa23-43c6-4caf-8298-50c57a468305 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:28.734568 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-da01aa23-43c6-4caf-8298-50c57a468305 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.083776 Jul 04 06:15:28.735143 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 955/1895] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:29.227670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-76a10ac6-a78e-4f40-9666-a054b0272673 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:29.228630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-76a10ac6-a78e-4f40-9666-a054b0272673 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:29.239703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76a10ac6-a78e-4f40-9666-a054b0272673 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:29.240152 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76a10ac6-a78e-4f40-9666-a054b0272673 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:29.240923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76a10ac6-a78e-4f40-9666-a054b0272673 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:29.241362 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76a10ac6-a78e-4f40-9666-a054b0272673 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:29.371836 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-76a10ac6-a78e-4f40-9666-a054b0272673 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:29.379875 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-76a10ac6-a78e-4f40-9666-a054b0272673 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158956 Jul 04 06:15:29.380442 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 941/1896] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:29 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:29.760126 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b4d0372e-9bdd-4a32-8c13-a738b6cd2430 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:29.761137 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b4d0372e-9bdd-4a32-8c13-a738b6cd2430 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:29.771814 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4d0372e-9bdd-4a32-8c13-a738b6cd2430 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:29.772201 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4d0372e-9bdd-4a32-8c13-a738b6cd2430 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:29.772964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4d0372e-9bdd-4a32-8c13-a738b6cd2430 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:29.773401 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4d0372e-9bdd-4a32-8c13-a738b6cd2430 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:29.840467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b4d0372e-9bdd-4a32-8c13-a738b6cd2430 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:29.848660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b4d0372e-9bdd-4a32-8c13-a738b6cd2430 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095079 Jul 04 06:15:29.849227 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 956/1897] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:30.399375 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8664ebb7-92e6-4cae-bfac-19002897b5ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:30.400073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8664ebb7-92e6-4cae-bfac-19002897b5ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:30.408462 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8664ebb7-92e6-4cae-bfac-19002897b5ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:30.408995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8664ebb7-92e6-4cae-bfac-19002897b5ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:30.409905 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8664ebb7-92e6-4cae-bfac-19002897b5ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:30.410417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8664ebb7-92e6-4cae-bfac-19002897b5ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:30.550280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8664ebb7-92e6-4cae-bfac-19002897b5ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:30.558573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8664ebb7-92e6-4cae-bfac-19002897b5ba tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164419 Jul 04 06:15:30.559151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 942/1898] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:30 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:30.869557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-53b9354a-1ea3-4835-8f10-f34e97c1ad52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:30.870576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-53b9354a-1ea3-4835-8f10-f34e97c1ad52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:30.881045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53b9354a-1ea3-4835-8f10-f34e97c1ad52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:30.881494 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53b9354a-1ea3-4835-8f10-f34e97c1ad52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:30.882250 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53b9354a-1ea3-4835-8f10-f34e97c1ad52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:30.882683 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53b9354a-1ea3-4835-8f10-f34e97c1ad52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:30.949729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-53b9354a-1ea3-4835-8f10-f34e97c1ad52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:30.961983 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-53b9354a-1ea3-4835-8f10-f34e97c1ad52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098796 Jul 04 06:15:30.962783 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 957/1899] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:30 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:31.580294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9a586a8b-cfba-4b25-b9ec-26bf25a321d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:31.581286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9a586a8b-cfba-4b25-b9ec-26bf25a321d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:31.592441 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a586a8b-cfba-4b25-b9ec-26bf25a321d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:31.593180 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a586a8b-cfba-4b25-b9ec-26bf25a321d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:31.594428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a586a8b-cfba-4b25-b9ec-26bf25a321d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:31.595640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a586a8b-cfba-4b25-b9ec-26bf25a321d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:31.740861 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a586a8b-cfba-4b25-b9ec-26bf25a321d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:31.752190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9a586a8b-cfba-4b25-b9ec-26bf25a321d7 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.178582 Jul 04 06:15:31.752824 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 943/1900] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:31 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:31.986849 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-73ff13d3-7d55-4d20-9cb9-72428a7edbe6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:31.987852 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-73ff13d3-7d55-4d20-9cb9-72428a7edbe6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:31.995789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73ff13d3-7d55-4d20-9cb9-72428a7edbe6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:31.996239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73ff13d3-7d55-4d20-9cb9-72428a7edbe6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:31.997051 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73ff13d3-7d55-4d20-9cb9-72428a7edbe6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:31.997487 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73ff13d3-7d55-4d20-9cb9-72428a7edbe6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:32.068159 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-73ff13d3-7d55-4d20-9cb9-72428a7edbe6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:32.080962 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-73ff13d3-7d55-4d20-9cb9-72428a7edbe6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.100437 Jul 04 06:15:32.081646 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 958/1901] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:31 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:32.773147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ead749f-70b3-45a9-ad0e-48c242ed053b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:32.773881 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ead749f-70b3-45a9-ad0e-48c242ed053b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:32.782232 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ead749f-70b3-45a9-ad0e-48c242ed053b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:32.782757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ead749f-70b3-45a9-ad0e-48c242ed053b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:32.783698 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ead749f-70b3-45a9-ad0e-48c242ed053b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:32.784210 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ead749f-70b3-45a9-ad0e-48c242ed053b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:32.990075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ead749f-70b3-45a9-ad0e-48c242ed053b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:32.998233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ead749f-70b3-45a9-ad0e-48c242ed053b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.231129 Jul 04 06:15:32.998778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 944/1902] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:32 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:33.098244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5cd326d-17b2-4f9e-9d3c-08f4d7ed6049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:33.098906 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5cd326d-17b2-4f9e-9d3c-08f4d7ed6049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:33.106007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5cd326d-17b2-4f9e-9d3c-08f4d7ed6049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:33.106483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5cd326d-17b2-4f9e-9d3c-08f4d7ed6049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:33.107277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5cd326d-17b2-4f9e-9d3c-08f4d7ed6049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:33.107720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5cd326d-17b2-4f9e-9d3c-08f4d7ed6049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:33.172277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d5cd326d-17b2-4f9e-9d3c-08f4d7ed6049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:33.180514 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5cd326d-17b2-4f9e-9d3c-08f4d7ed6049 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086231 Jul 04 06:15:33.181072 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 959/1903] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:34.021184 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-29da7d30-5019-4638-9f25-fad2dcaf2924 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:34.022237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-29da7d30-5019-4638-9f25-fad2dcaf2924 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:34.034151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29da7d30-5019-4638-9f25-fad2dcaf2924 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:34.034908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29da7d30-5019-4638-9f25-fad2dcaf2924 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:34.036213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29da7d30-5019-4638-9f25-fad2dcaf2924 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:34.036891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29da7d30-5019-4638-9f25-fad2dcaf2924 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:34.174985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-29da7d30-5019-4638-9f25-fad2dcaf2924 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:34.183152 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-29da7d30-5019-4638-9f25-fad2dcaf2924 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168800 Jul 04 06:15:34.183723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 945/1904] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:34 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:34.197443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-debcb597-bb7c-4430-9c91-fed33e091c41 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:34.198010 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-debcb597-bb7c-4430-9c91-fed33e091c41 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:34.204670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debcb597-bb7c-4430-9c91-fed33e091c41 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:34.205124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debcb597-bb7c-4430-9c91-fed33e091c41 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:34.205949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debcb597-bb7c-4430-9c91-fed33e091c41 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:34.206400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debcb597-bb7c-4430-9c91-fed33e091c41 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:34.209083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:15:34.332455 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-debcb597-bb7c-4430-9c91-fed33e091c41 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:34.341231 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-debcb597-bb7c-4430-9c91-fed33e091c41 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.147682 Jul 04 06:15:34.341781 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 960/1905] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:35.204831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-60c6fd50-f3a4-42d3-a35b-26c5aae323fa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:35.205807 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-60c6fd50-f3a4-42d3-a35b-26c5aae323fa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:35.214092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c6fd50-f3a4-42d3-a35b-26c5aae323fa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:35.214551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c6fd50-f3a4-42d3-a35b-26c5aae323fa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:35.215352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c6fd50-f3a4-42d3-a35b-26c5aae323fa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:35.215792 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c6fd50-f3a4-42d3-a35b-26c5aae323fa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:35.354321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-60c6fd50-f3a4-42d3-a35b-26c5aae323fa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:35.362048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0c93d9e0-a64e-47d1-8350-df512abe94b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:35.362653 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0c93d9e0-a64e-47d1-8350-df512abe94b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:35.362899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-60c6fd50-f3a4-42d3-a35b-26c5aae323fa tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164721 Jul 04 06:15:35.363703 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 946/1906] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:35 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:35.370120 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c93d9e0-a64e-47d1-8350-df512abe94b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:35.370736 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c93d9e0-a64e-47d1-8350-df512abe94b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:35.371541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c93d9e0-a64e-47d1-8350-df512abe94b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:35.371972 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c93d9e0-a64e-47d1-8350-df512abe94b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:35.434680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0c93d9e0-a64e-47d1-8350-df512abe94b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:35.443184 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0c93d9e0-a64e-47d1-8350-df512abe94b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.084991 Jul 04 06:15:35.443801 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 961/1907] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:36.384680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4d1a39b9-3ec9-44f0-b2e2-2f3286c13c65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:36.385722 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4d1a39b9-3ec9-44f0-b2e2-2f3286c13c65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:36.396638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d1a39b9-3ec9-44f0-b2e2-2f3286c13c65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:36.397084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d1a39b9-3ec9-44f0-b2e2-2f3286c13c65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:36.397848 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d1a39b9-3ec9-44f0-b2e2-2f3286c13c65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:36.398283 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d1a39b9-3ec9-44f0-b2e2-2f3286c13c65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:36.543571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d1a39b9-3ec9-44f0-b2e2-2f3286c13c65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:36.551672 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4d1a39b9-3ec9-44f0-b2e2-2f3286c13c65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.173565 Jul 04 06:15:36.552303 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 947/1908] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:36 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:36.587991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f49b39ce-8d38-426d-a77f-63a25cdc2252 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:36.588611 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f49b39ce-8d38-426d-a77f-63a25cdc2252 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:36.594807 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f49b39ce-8d38-426d-a77f-63a25cdc2252 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:36.595269 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f49b39ce-8d38-426d-a77f-63a25cdc2252 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:36.596064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f49b39ce-8d38-426d-a77f-63a25cdc2252 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:36.596499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f49b39ce-8d38-426d-a77f-63a25cdc2252 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:36.663104 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f49b39ce-8d38-426d-a77f-63a25cdc2252 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:36.671496 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f49b39ce-8d38-426d-a77f-63a25cdc2252 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.214640 Jul 04 06:15:36.672043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 962/1909] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:15:37.570082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9b47a74d-51eb-472e-a534-4f698f3ac85f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:37.570690 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9b47a74d-51eb-472e-a534-4f698f3ac85f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:37.573315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:15:37.579870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b47a74d-51eb-472e-a534-4f698f3ac85f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:37.580339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b47a74d-51eb-472e-a534-4f698f3ac85f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:37.581110 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b47a74d-51eb-472e-a534-4f698f3ac85f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:37.581553 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b47a74d-51eb-472e-a534-4f698f3ac85f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:37.688818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3fccd44c-248f-4bab-b8ba-3ef5b8cbfe2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:37.689573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3fccd44c-248f-4bab-b8ba-3ef5b8cbfe2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:37.696377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fccd44c-248f-4bab-b8ba-3ef5b8cbfe2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:37.696832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fccd44c-248f-4bab-b8ba-3ef5b8cbfe2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:37.697610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fccd44c-248f-4bab-b8ba-3ef5b8cbfe2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:37.698052 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fccd44c-248f-4bab-b8ba-3ef5b8cbfe2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:37.726114 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9b47a74d-51eb-472e-a534-4f698f3ac85f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:37.734467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9b47a74d-51eb-472e-a534-4f698f3ac85f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169427 Jul 04 06:15:37.735039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 948/1910] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:37 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:37.761069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3fccd44c-248f-4bab-b8ba-3ef5b8cbfe2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:37.769327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3fccd44c-248f-4bab-b8ba-3ef5b8cbfe2f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.084866 Jul 04 06:15:37.769796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 963/1911] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:38.756309 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3adeff5a-b705-4655-be57-d6d808be7413 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:38.757326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3adeff5a-b705-4655-be57-d6d808be7413 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:38.768315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3adeff5a-b705-4655-be57-d6d808be7413 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:38.769069 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3adeff5a-b705-4655-be57-d6d808be7413 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:38.770337 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3adeff5a-b705-4655-be57-d6d808be7413 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:38.771047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3adeff5a-b705-4655-be57-d6d808be7413 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:38.786475 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea7b2fe7-5a51-4a9a-a8aa-9c58b0222c2c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:38.787033 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea7b2fe7-5a51-4a9a-a8aa-9c58b0222c2c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:38.789337 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=54 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:15:38.794777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea7b2fe7-5a51-4a9a-a8aa-9c58b0222c2c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:38.795240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea7b2fe7-5a51-4a9a-a8aa-9c58b0222c2c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:38.796022 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea7b2fe7-5a51-4a9a-a8aa-9c58b0222c2c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:38.796456 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea7b2fe7-5a51-4a9a-a8aa-9c58b0222c2c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:38.862150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea7b2fe7-5a51-4a9a-a8aa-9c58b0222c2c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:38.870442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea7b2fe7-5a51-4a9a-a8aa-9c58b0222c2c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087986 Jul 04 06:15:38.870998 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 964/1912] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:38.915735 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3adeff5a-b705-4655-be57-d6d808be7413 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:38.924294 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3adeff5a-b705-4655-be57-d6d808be7413 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.174613 Jul 04 06:15:38.924876 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 949/1913] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:38 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:39.888820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a41910b-2ccf-42d0-99d9-225815bf981f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:39.889469 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a41910b-2ccf-42d0-99d9-225815bf981f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:39.897197 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a41910b-2ccf-42d0-99d9-225815bf981f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:39.897698 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a41910b-2ccf-42d0-99d9-225815bf981f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:39.898551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a41910b-2ccf-42d0-99d9-225815bf981f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:39.899040 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a41910b-2ccf-42d0-99d9-225815bf981f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:39.941508 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f4f534ed-fb34-46e3-b2a8-9653a1a33bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:39.942120 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f4f534ed-fb34-46e3-b2a8-9653a1a33bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:39.949443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4f534ed-fb34-46e3-b2a8-9653a1a33bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:39.949892 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4f534ed-fb34-46e3-b2a8-9653a1a33bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:39.950663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4f534ed-fb34-46e3-b2a8-9653a1a33bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:39.951121 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4f534ed-fb34-46e3-b2a8-9653a1a33bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:39.962509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8a41910b-2ccf-42d0-99d9-225815bf981f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:39.971002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a41910b-2ccf-42d0-99d9-225815bf981f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086666 Jul 04 06:15:39.971625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 965/1914] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:40.090670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f4f534ed-fb34-46e3-b2a8-9653a1a33bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:40.099090 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f4f534ed-fb34-46e3-b2a8-9653a1a33bd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.161437 Jul 04 06:15:40.099670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 950/1915] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:39 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:40.992151 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8d221d58-e043-44eb-b152-3fa3d08e715c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:40.992840 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8d221d58-e043-44eb-b152-3fa3d08e715c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:41.000551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d221d58-e043-44eb-b152-3fa3d08e715c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:41.001060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d221d58-e043-44eb-b152-3fa3d08e715c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:41.001912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d221d58-e043-44eb-b152-3fa3d08e715c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:41.002395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d221d58-e043-44eb-b152-3fa3d08e715c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:41.072828 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8d221d58-e043-44eb-b152-3fa3d08e715c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:41.081203 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8d221d58-e043-44eb-b152-3fa3d08e715c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094677 Jul 04 06:15:41.081779 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 966/1916] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:41.117021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-847e9830-646d-4eda-8ab2-ae344577f8c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:41.117591 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-847e9830-646d-4eda-8ab2-ae344577f8c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:41.124214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-847e9830-646d-4eda-8ab2-ae344577f8c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:41.124680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-847e9830-646d-4eda-8ab2-ae344577f8c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:41.125379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-847e9830-646d-4eda-8ab2-ae344577f8c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:41.125833 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-847e9830-646d-4eda-8ab2-ae344577f8c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:41.258251 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-847e9830-646d-4eda-8ab2-ae344577f8c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:41.267278 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-847e9830-646d-4eda-8ab2-ae344577f8c0 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.153840 Jul 04 06:15:41.267867 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 951/1917] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:41 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:42.101325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea7baa05-4a98-45cb-a20d-de3d8a1bcef0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:42.101968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea7baa05-4a98-45cb-a20d-de3d8a1bcef0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:42.109766 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea7baa05-4a98-45cb-a20d-de3d8a1bcef0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:42.110272 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea7baa05-4a98-45cb-a20d-de3d8a1bcef0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:42.111127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea7baa05-4a98-45cb-a20d-de3d8a1bcef0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:42.111675 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea7baa05-4a98-45cb-a20d-de3d8a1bcef0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:42.176030 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea7baa05-4a98-45cb-a20d-de3d8a1bcef0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:42.188531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea7baa05-4a98-45cb-a20d-de3d8a1bcef0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092693 Jul 04 06:15:42.189274 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 967/1918] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:42 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:42.288396 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a4a39ff8-e5ce-4205-bc10-a3f8c799d9e3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:42.289082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a4a39ff8-e5ce-4205-bc10-a3f8c799d9e3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:42.297226 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4a39ff8-e5ce-4205-bc10-a3f8c799d9e3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:42.297759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4a39ff8-e5ce-4205-bc10-a3f8c799d9e3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:42.298661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4a39ff8-e5ce-4205-bc10-a3f8c799d9e3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:42.299173 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4a39ff8-e5ce-4205-bc10-a3f8c799d9e3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:42.441130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a4a39ff8-e5ce-4205-bc10-a3f8c799d9e3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:42.453590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a4a39ff8-e5ce-4205-bc10-a3f8c799d9e3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170808 Jul 04 06:15:42.454267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 952/1919] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:42 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:43.206086 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2e699fd6-7c91-4fea-a719-d9dcc89723ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:43.206699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2e699fd6-7c91-4fea-a719-d9dcc89723ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:43.214395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e699fd6-7c91-4fea-a719-d9dcc89723ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:43.214853 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e699fd6-7c91-4fea-a719-d9dcc89723ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:43.215651 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e699fd6-7c91-4fea-a719-d9dcc89723ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:43.216085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e699fd6-7c91-4fea-a719-d9dcc89723ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:43.280406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2e699fd6-7c91-4fea-a719-d9dcc89723ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:43.289205 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2e699fd6-7c91-4fea-a719-d9dcc89723ef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087088 Jul 04 06:15:43.289786 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 968/1920] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:43.473676 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-045cb56b-c81a-43c9-88d3-a5cf328023ae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:43.474258 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-045cb56b-c81a-43c9-88d3-a5cf328023ae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:43.481434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-045cb56b-c81a-43c9-88d3-a5cf328023ae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:43.481873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-045cb56b-c81a-43c9-88d3-a5cf328023ae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:43.482623 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-045cb56b-c81a-43c9-88d3-a5cf328023ae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:43.483048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-045cb56b-c81a-43c9-88d3-a5cf328023ae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:43.624274 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-045cb56b-c81a-43c9-88d3-a5cf328023ae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:43.632696 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-045cb56b-c81a-43c9-88d3-a5cf328023ae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163134 Jul 04 06:15:43.633268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 953/1921] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:43 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:44.314658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ae03cfeb-ecde-4a8a-85db-504af51fd204 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:44.315736 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ae03cfeb-ecde-4a8a-85db-504af51fd204 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:44.323719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae03cfeb-ecde-4a8a-85db-504af51fd204 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:44.324151 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae03cfeb-ecde-4a8a-85db-504af51fd204 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:44.324991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae03cfeb-ecde-4a8a-85db-504af51fd204 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:44.325425 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae03cfeb-ecde-4a8a-85db-504af51fd204 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:44.388258 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae03cfeb-ecde-4a8a-85db-504af51fd204 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:44.396440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ae03cfeb-ecde-4a8a-85db-504af51fd204 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088354 Jul 04 06:15:44.397008 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 969/1922] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:44 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:44.655308 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c3152076-ab0b-4bb4-99c8-8b2addef5bac tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:44.656019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c3152076-ab0b-4bb4-99c8-8b2addef5bac tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:44.663597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3152076-ab0b-4bb4-99c8-8b2addef5bac tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:44.664103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3152076-ab0b-4bb4-99c8-8b2addef5bac tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:44.664957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3152076-ab0b-4bb4-99c8-8b2addef5bac tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:44.665441 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3152076-ab0b-4bb4-99c8-8b2addef5bac tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:44.803773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3152076-ab0b-4bb4-99c8-8b2addef5bac tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:44.812201 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c3152076-ab0b-4bb4-99c8-8b2addef5bac tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.161561 Jul 04 06:15:44.812778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 954/1923] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:44 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:45.418966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-186edad0-68ed-4d0d-b5af-0549f63a0835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:45.419968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-186edad0-68ed-4d0d-b5af-0549f63a0835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:45.429702 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-186edad0-68ed-4d0d-b5af-0549f63a0835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:45.430157 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-186edad0-68ed-4d0d-b5af-0549f63a0835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:45.430932 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-186edad0-68ed-4d0d-b5af-0549f63a0835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:45.431406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-186edad0-68ed-4d0d-b5af-0549f63a0835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:45.501871 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-186edad0-68ed-4d0d-b5af-0549f63a0835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:45.510285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-186edad0-68ed-4d0d-b5af-0549f63a0835 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097860 Jul 04 06:15:45.510855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 970/1924] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:45.833509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba3b6a0c-397c-45ec-b7c3-a5b2a36069b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:45.834550 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba3b6a0c-397c-45ec-b7c3-a5b2a36069b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:45.845955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba3b6a0c-397c-45ec-b7c3-a5b2a36069b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:45.846710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba3b6a0c-397c-45ec-b7c3-a5b2a36069b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:45.848060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba3b6a0c-397c-45ec-b7c3-a5b2a36069b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:45.848780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba3b6a0c-397c-45ec-b7c3-a5b2a36069b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:45.852588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:15:45.984974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ba3b6a0c-397c-45ec-b7c3-a5b2a36069b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:45.997355 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba3b6a0c-397c-45ec-b7c3-a5b2a36069b6 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169985 Jul 04 06:15:45.998163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 955/1925] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:45 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:46.532234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f299ffaa-64c6-4e64-a5ae-b95f33200644 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:46.533235 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f299ffaa-64c6-4e64-a5ae-b95f33200644 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:46.542099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f299ffaa-64c6-4e64-a5ae-b95f33200644 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:46.542548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f299ffaa-64c6-4e64-a5ae-b95f33200644 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:46.543357 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f299ffaa-64c6-4e64-a5ae-b95f33200644 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:46.543793 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f299ffaa-64c6-4e64-a5ae-b95f33200644 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:46.612541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f299ffaa-64c6-4e64-a5ae-b95f33200644 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:46.621047 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f299ffaa-64c6-4e64-a5ae-b95f33200644 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095886 Jul 04 06:15:46.621627 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 971/1926] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:46 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:47.022100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-826165b8-5105-4c20-80d8-b987b2cc9b2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:47.023023 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-826165b8-5105-4c20-80d8-b987b2cc9b2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:47.030818 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-826165b8-5105-4c20-80d8-b987b2cc9b2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:47.031284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-826165b8-5105-4c20-80d8-b987b2cc9b2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:47.032131 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-826165b8-5105-4c20-80d8-b987b2cc9b2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:47.032591 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-826165b8-5105-4c20-80d8-b987b2cc9b2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:47.177640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-826165b8-5105-4c20-80d8-b987b2cc9b2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:47.186525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-826165b8-5105-4c20-80d8-b987b2cc9b2a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170996 Jul 04 06:15:47.187104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 956/1927] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:47 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:47.638751 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-63d89bd0-991f-4904-a4f8-ac898f3fdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:47.639389 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-63d89bd0-991f-4904-a4f8-ac898f3fdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:47.646240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63d89bd0-991f-4904-a4f8-ac898f3fdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:47.646689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63d89bd0-991f-4904-a4f8-ac898f3fdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:47.647566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63d89bd0-991f-4904-a4f8-ac898f3fdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:47.648000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63d89bd0-991f-4904-a4f8-ac898f3fdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:47.722357 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-63d89bd0-991f-4904-a4f8-ac898f3fdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:47.730876 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-63d89bd0-991f-4904-a4f8-ac898f3fdf20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096568 Jul 04 06:15:47.731480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 972/1928] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:48.204331 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d2358749-5742-4995-a995-62986ef3ebd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:48.205018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d2358749-5742-4995-a995-62986ef3ebd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:48.212372 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2358749-5742-4995-a995-62986ef3ebd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:48.212842 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2358749-5742-4995-a995-62986ef3ebd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:48.213643 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2358749-5742-4995-a995-62986ef3ebd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:48.214148 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2358749-5742-4995-a995-62986ef3ebd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:48.353567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2358749-5742-4995-a995-62986ef3ebd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:48.366130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d2358749-5742-4995-a995-62986ef3ebd3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165711 Jul 04 06:15:48.366809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 957/1929] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:48 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:48.751783 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-88fea461-2e06-42cb-ad61-8ab4ad211a5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:48.752810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-88fea461-2e06-42cb-ad61-8ab4ad211a5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:48.761367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88fea461-2e06-42cb-ad61-8ab4ad211a5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:48.761820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88fea461-2e06-42cb-ad61-8ab4ad211a5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:48.762587 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88fea461-2e06-42cb-ad61-8ab4ad211a5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:48.763017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88fea461-2e06-42cb-ad61-8ab4ad211a5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:48.833648 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-88fea461-2e06-42cb-ad61-8ab4ad211a5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:48.845975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-88fea461-2e06-42cb-ad61-8ab4ad211a5c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.100368 Jul 04 06:15:48.846705 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 973/1930] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:49.386620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c35ee92d-dc57-436f-98a2-ae6ad20eb065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:49.387223 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c35ee92d-dc57-436f-98a2-ae6ad20eb065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:49.396506 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c35ee92d-dc57-436f-98a2-ae6ad20eb065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:49.396981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c35ee92d-dc57-436f-98a2-ae6ad20eb065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:49.398048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c35ee92d-dc57-436f-98a2-ae6ad20eb065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:49.398476 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c35ee92d-dc57-436f-98a2-ae6ad20eb065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:49.528423 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c35ee92d-dc57-436f-98a2-ae6ad20eb065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:49.540183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c35ee92d-dc57-436f-98a2-ae6ad20eb065 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.160043 Jul 04 06:15:49.540771 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 958/1931] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:49 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:49.868305 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-682ecbd9-a57c-4187-afe8-8f9b4a785e11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:49.869041 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-682ecbd9-a57c-4187-afe8-8f9b4a785e11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:49.877497 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-682ecbd9-a57c-4187-afe8-8f9b4a785e11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:49.878417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-682ecbd9-a57c-4187-afe8-8f9b4a785e11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:49.879427 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-682ecbd9-a57c-4187-afe8-8f9b4a785e11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:49.879980 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-682ecbd9-a57c-4187-afe8-8f9b4a785e11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:49.950002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-682ecbd9-a57c-4187-afe8-8f9b4a785e11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:49.958365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-682ecbd9-a57c-4187-afe8-8f9b4a785e11 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096263 Jul 04 06:15:49.958949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 974/1932] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:50.557805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1eebb95d-b041-46cc-aa76-45ec8de88c56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:50.558419 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1eebb95d-b041-46cc-aa76-45ec8de88c56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:50.565460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eebb95d-b041-46cc-aa76-45ec8de88c56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:50.565912 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eebb95d-b041-46cc-aa76-45ec8de88c56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:50.566710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eebb95d-b041-46cc-aa76-45ec8de88c56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:50.567145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eebb95d-b041-46cc-aa76-45ec8de88c56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:50.706612 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1eebb95d-b041-46cc-aa76-45ec8de88c56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:50.716037 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1eebb95d-b041-46cc-aa76-45ec8de88c56 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162198 Jul 04 06:15:50.716601 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 959/1933] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:50 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:50.978064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-063d187a-2f35-472c-bf3e-3eb47d423f60 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:50.978657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-063d187a-2f35-472c-bf3e-3eb47d423f60 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:50.985659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-063d187a-2f35-472c-bf3e-3eb47d423f60 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:50.986109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-063d187a-2f35-472c-bf3e-3eb47d423f60 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:50.986882 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-063d187a-2f35-472c-bf3e-3eb47d423f60 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:50.987676 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-063d187a-2f35-472c-bf3e-3eb47d423f60 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:51.066441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-063d187a-2f35-472c-bf3e-3eb47d423f60 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:51.075089 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-063d187a-2f35-472c-bf3e-3eb47d423f60 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.102340 Jul 04 06:15:51.075692 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 975/1934] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:50 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:51.737389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b0270173-ea36-44c3-9cf8-0ea031d2c338 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:51.738341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b0270173-ea36-44c3-9cf8-0ea031d2c338 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:51.749323 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0270173-ea36-44c3-9cf8-0ea031d2c338 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:51.750065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0270173-ea36-44c3-9cf8-0ea031d2c338 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:51.751324 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0270173-ea36-44c3-9cf8-0ea031d2c338 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:51.752076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0270173-ea36-44c3-9cf8-0ea031d2c338 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:51.844313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:15:51.844537 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:15:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:15:51.884863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b0270173-ea36-44c3-9cf8-0ea031d2c338 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:51.893229 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b0270173-ea36-44c3-9cf8-0ea031d2c338 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162328 Jul 04 06:15:51.893802 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 960/1935] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:51 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:52.096459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-32d14521-d9bc-4d35-9ffb-cb9e32087713 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:52.097469 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-32d14521-d9bc-4d35-9ffb-cb9e32087713 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:52.112972 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32d14521-d9bc-4d35-9ffb-cb9e32087713 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:52.114109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32d14521-d9bc-4d35-9ffb-cb9e32087713 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:52.115449 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32d14521-d9bc-4d35-9ffb-cb9e32087713 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:52.116292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32d14521-d9bc-4d35-9ffb-cb9e32087713 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:52.194101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-32d14521-d9bc-4d35-9ffb-cb9e32087713 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:52.196403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:15:52.203607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-32d14521-d9bc-4d35-9ffb-cb9e32087713 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.113732 Jul 04 06:15:52.204214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 976/1936] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:52 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:52.915427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab5fda4d-007d-44fc-ab09-9ecce3aef0dd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:52.916340 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab5fda4d-007d-44fc-ab09-9ecce3aef0dd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:52.927311 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5fda4d-007d-44fc-ab09-9ecce3aef0dd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:52.928107 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5fda4d-007d-44fc-ab09-9ecce3aef0dd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:52.929241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5fda4d-007d-44fc-ab09-9ecce3aef0dd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:52.929671 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5fda4d-007d-44fc-ab09-9ecce3aef0dd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:53.083027 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab5fda4d-007d-44fc-ab09-9ecce3aef0dd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:53.092237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab5fda4d-007d-44fc-ab09-9ecce3aef0dd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.183486 Jul 04 06:15:53.092777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 961/1937] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:52 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:53.225034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-55c14953-5369-4e41-b473-e6a6c007f35f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:53.226057 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-55c14953-5369-4e41-b473-e6a6c007f35f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:53.232874 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55c14953-5369-4e41-b473-e6a6c007f35f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:53.233343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55c14953-5369-4e41-b473-e6a6c007f35f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:53.234120 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55c14953-5369-4e41-b473-e6a6c007f35f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:53.234557 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55c14953-5369-4e41-b473-e6a6c007f35f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:53.297019 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-55c14953-5369-4e41-b473-e6a6c007f35f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:53.305186 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-55c14953-5369-4e41-b473-e6a6c007f35f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087097 Jul 04 06:15:53.305757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 977/1938] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:53 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:54.110770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e927ad1-583d-45ec-b22d-796aae2f4698 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:54.111534 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9e927ad1-583d-45ec-b22d-796aae2f4698 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:54.119394 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e927ad1-583d-45ec-b22d-796aae2f4698 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:54.119946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e927ad1-583d-45ec-b22d-796aae2f4698 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:54.120836 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e927ad1-583d-45ec-b22d-796aae2f4698 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:54.121339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e927ad1-583d-45ec-b22d-796aae2f4698 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:54.223164 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:15:54.223403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:15:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:15:54.263562 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9e927ad1-583d-45ec-b22d-796aae2f4698 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:54.275620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e927ad1-583d-45ec-b22d-796aae2f4698 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.169010 Jul 04 06:15:54.276756 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 962/1939] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:54 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:54.330337 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e74bc8dc-8646-48a1-a45a-b98a6f951b02 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:54.331372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e74bc8dc-8646-48a1-a45a-b98a6f951b02 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:54.339563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e74bc8dc-8646-48a1-a45a-b98a6f951b02 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:54.340029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e74bc8dc-8646-48a1-a45a-b98a6f951b02 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:54.340765 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e74bc8dc-8646-48a1-a45a-b98a6f951b02 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:54.341192 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e74bc8dc-8646-48a1-a45a-b98a6f951b02 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:54.403876 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e74bc8dc-8646-48a1-a45a-b98a6f951b02 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:54.412326 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e74bc8dc-8646-48a1-a45a-b98a6f951b02 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088401 Jul 04 06:15:54.412911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 978/1940] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:55.301539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f99edb31-0d57-4218-afa6-e0e84cd22195 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:55.302272 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f99edb31-0d57-4218-afa6-e0e84cd22195 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:55.309917 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f99edb31-0d57-4218-afa6-e0e84cd22195 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:55.310368 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f99edb31-0d57-4218-afa6-e0e84cd22195 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:55.311134 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f99edb31-0d57-4218-afa6-e0e84cd22195 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:55.311595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f99edb31-0d57-4218-afa6-e0e84cd22195 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:55.433244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-98468660-5569-4397-8362-0a9a4904b275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:55.433884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-98468660-5569-4397-8362-0a9a4904b275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:55.440434 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98468660-5569-4397-8362-0a9a4904b275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:55.440924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98468660-5569-4397-8362-0a9a4904b275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:55.441701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98468660-5569-4397-8362-0a9a4904b275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:55.442139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98468660-5569-4397-8362-0a9a4904b275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:55.443192 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f99edb31-0d57-4218-afa6-e0e84cd22195 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:55.451516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f99edb31-0d57-4218-afa6-e0e84cd22195 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156464 Jul 04 06:15:55.452098 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 963/1941] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:55 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:55.505813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-98468660-5569-4397-8362-0a9a4904b275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:55.514759 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-98468660-5569-4397-8362-0a9a4904b275 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085456 Jul 04 06:15:55.515336 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 979/1942] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:56.470800 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1bccd3f4-207b-4b71-a10d-b123789de287 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:56.471393 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1bccd3f4-207b-4b71-a10d-b123789de287 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:56.479734 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bccd3f4-207b-4b71-a10d-b123789de287 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:56.480186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bccd3f4-207b-4b71-a10d-b123789de287 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:56.480957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bccd3f4-207b-4b71-a10d-b123789de287 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:56.481391 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bccd3f4-207b-4b71-a10d-b123789de287 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:56.532610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-99597728-ca35-4c94-9122-21193cc357c2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:56.533225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-99597728-ca35-4c94-9122-21193cc357c2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:56.540176 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99597728-ca35-4c94-9122-21193cc357c2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:56.540630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99597728-ca35-4c94-9122-21193cc357c2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:56.541398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99597728-ca35-4c94-9122-21193cc357c2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:56.541837 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99597728-ca35-4c94-9122-21193cc357c2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:56.607411 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-99597728-ca35-4c94-9122-21193cc357c2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:56.616875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-99597728-ca35-4c94-9122-21193cc357c2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088245 Jul 04 06:15:56.617452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 980/1943] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:56 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:56.619229 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1bccd3f4-207b-4b71-a10d-b123789de287 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:56.627449 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1bccd3f4-207b-4b71-a10d-b123789de287 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.162994 Jul 04 06:15:56.628003 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 964/1944] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:56 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:57.638708 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6986943b-7b80-428e-8ff2-0381a86742d1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:57.639964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6986943b-7b80-428e-8ff2-0381a86742d1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:57.646743 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b4806ca-41da-4c2e-a3aa-c7371f89c4b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:57.647641 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2b4806ca-41da-4c2e-a3aa-c7371f89c4b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:57.649713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6986943b-7b80-428e-8ff2-0381a86742d1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:57.650175 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6986943b-7b80-428e-8ff2-0381a86742d1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:57.651451 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6986943b-7b80-428e-8ff2-0381a86742d1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:57.651892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6986943b-7b80-428e-8ff2-0381a86742d1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:57.654630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b4806ca-41da-4c2e-a3aa-c7371f89c4b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:57.655100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b4806ca-41da-4c2e-a3aa-c7371f89c4b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:57.656169 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b4806ca-41da-4c2e-a3aa-c7371f89c4b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:57.656603 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b4806ca-41da-4c2e-a3aa-c7371f89c4b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:57.714324 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6986943b-7b80-428e-8ff2-0381a86742d1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:57.722459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6986943b-7b80-428e-8ff2-0381a86742d1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091802 Jul 04 06:15:57.723036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 981/1945] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:57 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:57.785467 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2b4806ca-41da-4c2e-a3aa-c7371f89c4b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:57.794906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2b4806ca-41da-4c2e-a3aa-c7371f89c4b2 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.152461 Jul 04 06:15:57.795515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 965/1946] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:57 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:58.743610 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-74d48fb8-8056-4088-b14f-50ab21cbec69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:58.744586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-74d48fb8-8056-4088-b14f-50ab21cbec69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:58.755741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74d48fb8-8056-4088-b14f-50ab21cbec69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:58.756485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74d48fb8-8056-4088-b14f-50ab21cbec69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:58.757575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74d48fb8-8056-4088-b14f-50ab21cbec69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:58.758010 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74d48fb8-8056-4088-b14f-50ab21cbec69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:58.813679 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e944ca1-74d7-45ea-9638-0db27c18c85e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:58.814262 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4e944ca1-74d7-45ea-9638-0db27c18c85e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:58.822726 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e944ca1-74d7-45ea-9638-0db27c18c85e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:58.823321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e944ca1-74d7-45ea-9638-0db27c18c85e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:58.824118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e944ca1-74d7-45ea-9638-0db27c18c85e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:58.824546 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e944ca1-74d7-45ea-9638-0db27c18c85e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:58.830564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-74d48fb8-8056-4088-b14f-50ab21cbec69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:58.839093 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-74d48fb8-8056-4088-b14f-50ab21cbec69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.102031 Jul 04 06:15:58.839716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 982/1947] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:58.955291 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4e944ca1-74d7-45ea-9638-0db27c18c85e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:58.963764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4e944ca1-74d7-45ea-9638-0db27c18c85e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.156311 Jul 04 06:15:58.964334 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 966/1948] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:58 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:59.859918 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-181f52f9-8eeb-4c9d-b71c-66232da2279d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:59.860939 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-181f52f9-8eeb-4c9d-b71c-66232da2279d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:59.869924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-181f52f9-8eeb-4c9d-b71c-66232da2279d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:59.870380 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-181f52f9-8eeb-4c9d-b71c-66232da2279d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:59.871147 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-181f52f9-8eeb-4c9d-b71c-66232da2279d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:59.871642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-181f52f9-8eeb-4c9d-b71c-66232da2279d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:59.939416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-181f52f9-8eeb-4c9d-b71c-66232da2279d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:15:59.947964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-181f52f9-8eeb-4c9d-b71c-66232da2279d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094565 Jul 04 06:15:59.948550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 983/1949] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:15:59.981606 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c7a01278-3c32-4b40-9c41-67e5c81b3f90 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:15:59.982216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c7a01278-3c32-4b40-9c41-67e5c81b3f90 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:15:59.989119 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7a01278-3c32-4b40-9c41-67e5c81b3f90 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:59.989563 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7a01278-3c32-4b40-9c41-67e5c81b3f90 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:15:59.990328 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7a01278-3c32-4b40-9c41-67e5c81b3f90 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:15:59.990760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7a01278-3c32-4b40-9c41-67e5c81b3f90 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:00.132463 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c7a01278-3c32-4b40-9c41-67e5c81b3f90 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:00.140561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c7a01278-3c32-4b40-9c41-67e5c81b3f90 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163134 Jul 04 06:16:00.141123 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 967/1950] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:15:59 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:00.967063 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-88dd85ca-ceb3-4c03-aa0a-33be1a3bdb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:00.967718 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-88dd85ca-ceb3-4c03-aa0a-33be1a3bdb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:00.976421 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88dd85ca-ceb3-4c03-aa0a-33be1a3bdb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:00.977480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88dd85ca-ceb3-4c03-aa0a-33be1a3bdb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:00.978344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88dd85ca-ceb3-4c03-aa0a-33be1a3bdb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:00.978775 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88dd85ca-ceb3-4c03-aa0a-33be1a3bdb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:01.046856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-88dd85ca-ceb3-4c03-aa0a-33be1a3bdb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:01.055567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-88dd85ca-ceb3-4c03-aa0a-33be1a3bdb94 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093097 Jul 04 06:16:01.056134 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 984/1951] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:00 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:01.162929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8116ce12-b9a0-49bc-a34b-2821f63923a3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:01.163608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8116ce12-b9a0-49bc-a34b-2821f63923a3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:01.173298 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8116ce12-b9a0-49bc-a34b-2821f63923a3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:01.173890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8116ce12-b9a0-49bc-a34b-2821f63923a3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:01.175051 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8116ce12-b9a0-49bc-a34b-2821f63923a3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:01.175613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8116ce12-b9a0-49bc-a34b-2821f63923a3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:01.330121 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8116ce12-b9a0-49bc-a34b-2821f63923a3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:01.338872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8116ce12-b9a0-49bc-a34b-2821f63923a3 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.182287 Jul 04 06:16:01.339613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 968/1952] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:01 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:02.077191 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-23fa27c1-9ad0-4fe1-a961-3569ec79ca7f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:02.078077 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-23fa27c1-9ad0-4fe1-a961-3569ec79ca7f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:02.088535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23fa27c1-9ad0-4fe1-a961-3569ec79ca7f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:02.088981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23fa27c1-9ad0-4fe1-a961-3569ec79ca7f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:02.089784 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23fa27c1-9ad0-4fe1-a961-3569ec79ca7f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:02.090213 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-23fa27c1-9ad0-4fe1-a961-3569ec79ca7f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:02.157466 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-23fa27c1-9ad0-4fe1-a961-3569ec79ca7f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:02.168798 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-23fa27c1-9ad0-4fe1-a961-3569ec79ca7f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098356 Jul 04 06:16:02.169372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 985/1953] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:02 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:02.358371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb699c60-89b0-4c30-8b56-42689c0893a8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:02.358965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb699c60-89b0-4c30-8b56-42689c0893a8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:02.365927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb699c60-89b0-4c30-8b56-42689c0893a8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:02.366376 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb699c60-89b0-4c30-8b56-42689c0893a8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:02.367181 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb699c60-89b0-4c30-8b56-42689c0893a8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:02.367643 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb699c60-89b0-4c30-8b56-42689c0893a8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:02.509212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb699c60-89b0-4c30-8b56-42689c0893a8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:02.517488 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb699c60-89b0-4c30-8b56-42689c0893a8 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.163217 Jul 04 06:16:02.518331 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 969/1954] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:02 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:03.185896 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a5c911fa-57f4-46de-b48a-a9053f875bfe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:03.186547 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a5c911fa-57f4-46de-b48a-a9053f875bfe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:03.193200 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5c911fa-57f4-46de-b48a-a9053f875bfe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:03.193654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5c911fa-57f4-46de-b48a-a9053f875bfe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:03.194424 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5c911fa-57f4-46de-b48a-a9053f875bfe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:03.194856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5c911fa-57f4-46de-b48a-a9053f875bfe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:03.259739 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a5c911fa-57f4-46de-b48a-a9053f875bfe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:03.267768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a5c911fa-57f4-46de-b48a-a9053f875bfe tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085821 Jul 04 06:16:03.268376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 986/1955] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:03.535474 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c570d22f-e214-47b9-8e9b-bbe68cbf5b73 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:03.536073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c570d22f-e214-47b9-8e9b-bbe68cbf5b73 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:03.543158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c570d22f-e214-47b9-8e9b-bbe68cbf5b73 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:03.543624 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c570d22f-e214-47b9-8e9b-bbe68cbf5b73 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:03.544380 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c570d22f-e214-47b9-8e9b-bbe68cbf5b73 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:03.544806 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c570d22f-e214-47b9-8e9b-bbe68cbf5b73 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:03.682973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c570d22f-e214-47b9-8e9b-bbe68cbf5b73 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:03.691123 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c570d22f-e214-47b9-8e9b-bbe68cbf5b73 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159591 Jul 04 06:16:03.691723 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 970/1956] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:03 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:04.289026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0fb11b33-f058-4df9-952c-e14c1588ecee tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:04.290035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0fb11b33-f058-4df9-952c-e14c1588ecee tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:04.300682 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fb11b33-f058-4df9-952c-e14c1588ecee tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:04.301398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fb11b33-f058-4df9-952c-e14c1588ecee tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:04.302680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fb11b33-f058-4df9-952c-e14c1588ecee tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:04.303456 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fb11b33-f058-4df9-952c-e14c1588ecee tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:04.364379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0fb11b33-f058-4df9-952c-e14c1588ecee tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:04.372593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0fb11b33-f058-4df9-952c-e14c1588ecee tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090121 Jul 04 06:16:04.373172 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 987/1957] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:04.712099 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2f806b7-990c-4814-ab15-81e22907774b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:04.713094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c2f806b7-990c-4814-ab15-81e22907774b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:04.724285 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2f806b7-990c-4814-ab15-81e22907774b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:04.725024 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2f806b7-990c-4814-ab15-81e22907774b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:04.726284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2f806b7-990c-4814-ab15-81e22907774b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:04.727002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2f806b7-990c-4814-ab15-81e22907774b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:04.866816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c2f806b7-990c-4814-ab15-81e22907774b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:04.869341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:16:04.876517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2f806b7-990c-4814-ab15-81e22907774b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.170901 Jul 04 06:16:04.877088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 971/1958] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:04 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:05.396017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-17bab503-4ec3-4d06-95be-d49d785c940d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:05.396970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-17bab503-4ec3-4d06-95be-d49d785c940d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:05.408294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17bab503-4ec3-4d06-95be-d49d785c940d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:05.409137 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17bab503-4ec3-4d06-95be-d49d785c940d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:05.410388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17bab503-4ec3-4d06-95be-d49d785c940d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:05.411130 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17bab503-4ec3-4d06-95be-d49d785c940d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:05.477746 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-17bab503-4ec3-4d06-95be-d49d785c940d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:05.486462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-17bab503-4ec3-4d06-95be-d49d785c940d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098424 Jul 04 06:16:05.487035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 988/1959] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:05 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:05.897900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7119f150-640f-40b4-b8ff-951620526752 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:05.899118 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7119f150-640f-40b4-b8ff-951620526752 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:05.910926 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7119f150-640f-40b4-b8ff-951620526752 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:05.911744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7119f150-640f-40b4-b8ff-951620526752 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:05.913009 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7119f150-640f-40b4-b8ff-951620526752 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:05.913738 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7119f150-640f-40b4-b8ff-951620526752 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:06.050034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7119f150-640f-40b4-b8ff-951620526752 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:06.058125 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7119f150-640f-40b4-b8ff-951620526752 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.166822 Jul 04 06:16:06.058694 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 972/1960] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:05 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:06.507233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-051ef442-e1c7-4b60-9eaa-162ea1e002f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:06.508233 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-051ef442-e1c7-4b60-9eaa-162ea1e002f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:06.519012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-051ef442-e1c7-4b60-9eaa-162ea1e002f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:06.519787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-051ef442-e1c7-4b60-9eaa-162ea1e002f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:06.521045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-051ef442-e1c7-4b60-9eaa-162ea1e002f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:06.522624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-051ef442-e1c7-4b60-9eaa-162ea1e002f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:06.588023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-051ef442-e1c7-4b60-9eaa-162ea1e002f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:06.596448 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-051ef442-e1c7-4b60-9eaa-162ea1e002f9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095707 Jul 04 06:16:06.597033 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 989/1961] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:07.081040 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c67f3d48-659f-4ec0-9409-37dd1f840123 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:07.082028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c67f3d48-659f-4ec0-9409-37dd1f840123 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:07.091548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c67f3d48-659f-4ec0-9409-37dd1f840123 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:07.091997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c67f3d48-659f-4ec0-9409-37dd1f840123 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:07.092776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c67f3d48-659f-4ec0-9409-37dd1f840123 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:07.093198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c67f3d48-659f-4ec0-9409-37dd1f840123 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:07.248989 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c67f3d48-659f-4ec0-9409-37dd1f840123 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:07.257815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c67f3d48-659f-4ec0-9409-37dd1f840123 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.184705 Jul 04 06:16:07.258382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 973/1962] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:07 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:07.613582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5498b4df-fb29-4599-9ee5-65a0637c6f78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:07.614202 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5498b4df-fb29-4599-9ee5-65a0637c6f78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:07.621416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5498b4df-fb29-4599-9ee5-65a0637c6f78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:07.621861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5498b4df-fb29-4599-9ee5-65a0637c6f78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:07.622621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5498b4df-fb29-4599-9ee5-65a0637c6f78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:07.623046 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5498b4df-fb29-4599-9ee5-65a0637c6f78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:07.691764 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5498b4df-fb29-4599-9ee5-65a0637c6f78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:07.701905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5498b4df-fb29-4599-9ee5-65a0637c6f78 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092275 Jul 04 06:16:07.702462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 990/1963] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:08.279612 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b3ed3956-cc5a-49d9-93b8-8937cc745d5e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:08.280612 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b3ed3956-cc5a-49d9-93b8-8937cc745d5e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:08.284312 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:16:08.293119 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3ed3956-cc5a-49d9-93b8-8937cc745d5e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:08.293559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3ed3956-cc5a-49d9-93b8-8937cc745d5e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:08.294323 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3ed3956-cc5a-49d9-93b8-8937cc745d5e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:08.294753 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3ed3956-cc5a-49d9-93b8-8937cc745d5e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:08.428803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b3ed3956-cc5a-49d9-93b8-8937cc745d5e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:08.436844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b3ed3956-cc5a-49d9-93b8-8937cc745d5e tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.164228 Jul 04 06:16:08.437405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 974/1964] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:08 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:08.723164 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8911c140-6ef5-4d0c-8fb0-b3647a129605 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:08.724263 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8911c140-6ef5-4d0c-8fb0-b3647a129605 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:08.735364 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8911c140-6ef5-4d0c-8fb0-b3647a129605 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:08.736154 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8911c140-6ef5-4d0c-8fb0-b3647a129605 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:08.737419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8911c140-6ef5-4d0c-8fb0-b3647a129605 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:08.738145 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8911c140-6ef5-4d0c-8fb0-b3647a129605 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:08.803529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8911c140-6ef5-4d0c-8fb0-b3647a129605 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:08.811777 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8911c140-6ef5-4d0c-8fb0-b3647a129605 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095231 Jul 04 06:16:08.812347 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 991/1965] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:08 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:09.456711 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b9046a39-e56f-407b-a909-33becca3e0c9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:09.457438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b9046a39-e56f-407b-a909-33becca3e0c9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:09.466271 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9046a39-e56f-407b-a909-33becca3e0c9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:09.466711 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9046a39-e56f-407b-a909-33becca3e0c9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:09.467500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9046a39-e56f-407b-a909-33becca3e0c9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:09.467908 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9046a39-e56f-407b-a909-33becca3e0c9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:09.609551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b9046a39-e56f-407b-a909-33becca3e0c9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:09.617666 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b9046a39-e56f-407b-a909-33becca3e0c9 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.167176 Jul 04 06:16:09.618239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 975/1966] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:09 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:09.832982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2fa6a8d5-0c5b-419d-94db-8afde0e0a831 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:09.833919 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2fa6a8d5-0c5b-419d-94db-8afde0e0a831 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:09.837620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:16:09.846611 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fa6a8d5-0c5b-419d-94db-8afde0e0a831 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:09.847403 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fa6a8d5-0c5b-419d-94db-8afde0e0a831 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:09.848664 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fa6a8d5-0c5b-419d-94db-8afde0e0a831 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:09.849380 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fa6a8d5-0c5b-419d-94db-8afde0e0a831 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:09.917023 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2fa6a8d5-0c5b-419d-94db-8afde0e0a831 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:09.925645 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2fa6a8d5-0c5b-419d-94db-8afde0e0a831 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.099289 Jul 04 06:16:09.926209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 992/1967] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:10.638333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db0cf963-0d17-43df-a0e6-973829c04cbe tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:10.639063 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db0cf963-0d17-43df-a0e6-973829c04cbe tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:10.647603 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db0cf963-0d17-43df-a0e6-973829c04cbe tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:10.648260 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db0cf963-0d17-43df-a0e6-973829c04cbe tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:10.649106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db0cf963-0d17-43df-a0e6-973829c04cbe tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:10.649652 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db0cf963-0d17-43df-a0e6-973829c04cbe tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:10.789512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db0cf963-0d17-43df-a0e6-973829c04cbe tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:10.797885 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db0cf963-0d17-43df-a0e6-973829c04cbe tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165411 Jul 04 06:16:10.798455 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 976/1968] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:10 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:10.942698 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7eac5e22-0373-4d1c-a2ba-611ce87fff46 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:10.943413 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7eac5e22-0373-4d1c-a2ba-611ce87fff46 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:10.950367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7eac5e22-0373-4d1c-a2ba-611ce87fff46 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:10.950847 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7eac5e22-0373-4d1c-a2ba-611ce87fff46 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:10.951639 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7eac5e22-0373-4d1c-a2ba-611ce87fff46 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:10.952081 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7eac5e22-0373-4d1c-a2ba-611ce87fff46 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:10.967662 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:16:11.018909 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7eac5e22-0373-4d1c-a2ba-611ce87fff46 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:11.028507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7eac5e22-0373-4d1c-a2ba-611ce87fff46 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089695 Jul 04 06:16:11.029090 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 993/1969] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:10 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:11.818730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e871e609-ffa9-41a5-a1c1-53119b059e08 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:11.819664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e871e609-ffa9-41a5-a1c1-53119b059e08 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:11.830759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e871e609-ffa9-41a5-a1c1-53119b059e08 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:11.831567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e871e609-ffa9-41a5-a1c1-53119b059e08 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:11.832832 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e871e609-ffa9-41a5-a1c1-53119b059e08 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:11.833608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e871e609-ffa9-41a5-a1c1-53119b059e08 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:11.971874 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e871e609-ffa9-41a5-a1c1-53119b059e08 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:11.980295 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e871e609-ffa9-41a5-a1c1-53119b059e08 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168204 Jul 04 06:16:11.980861 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 977/1970] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:11 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:12.046099 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-44d3cbd1-2c0f-4a66-a1dc-c9be981cac52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:12.046690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-44d3cbd1-2c0f-4a66-a1dc-c9be981cac52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:12.055650 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44d3cbd1-2c0f-4a66-a1dc-c9be981cac52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:12.056267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44d3cbd1-2c0f-4a66-a1dc-c9be981cac52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:12.057491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44d3cbd1-2c0f-4a66-a1dc-c9be981cac52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:12.058134 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44d3cbd1-2c0f-4a66-a1dc-c9be981cac52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:12.124348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-44d3cbd1-2c0f-4a66-a1dc-c9be981cac52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:12.132550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-44d3cbd1-2c0f-4a66-a1dc-c9be981cac52 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090643 Jul 04 06:16:12.133122 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 994/1971] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:12 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:13.001916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c977cb6a-161a-446d-86c4-d9f6f5b5aa76 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:13.002886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c977cb6a-161a-446d-86c4-d9f6f5b5aa76 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:13.014215 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c977cb6a-161a-446d-86c4-d9f6f5b5aa76 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:13.014965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c977cb6a-161a-446d-86c4-d9f6f5b5aa76 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:13.016273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c977cb6a-161a-446d-86c4-d9f6f5b5aa76 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:13.016988 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c977cb6a-161a-446d-86c4-d9f6f5b5aa76 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:13.148412 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-510073c8-67ec-4767-9c87-92ebffb1e5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:13.149169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-510073c8-67ec-4767-9c87-92ebffb1e5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:13.156006 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-510073c8-67ec-4767-9c87-92ebffb1e5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:13.156459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-510073c8-67ec-4767-9c87-92ebffb1e5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:13.157256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-510073c8-67ec-4767-9c87-92ebffb1e5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:13.157658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-510073c8-67ec-4767-9c87-92ebffb1e5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:13.160148 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c977cb6a-161a-446d-86c4-d9f6f5b5aa76 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:13.168894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c977cb6a-161a-446d-86c4-d9f6f5b5aa76 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.173706 Jul 04 06:16:13.170105 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 978/1972] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:12 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:13.223927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-510073c8-67ec-4767-9c87-92ebffb1e5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:13.236651 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-510073c8-67ec-4767-9c87-92ebffb1e5ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091952 Jul 04 06:16:13.237445 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 995/1973] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:13 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:14.190900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1c86c3d7-85f5-4e8d-8430-7156f66a2bfc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:14.191884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1c86c3d7-85f5-4e8d-8430-7156f66a2bfc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:14.201139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c86c3d7-85f5-4e8d-8430-7156f66a2bfc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:14.201583 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c86c3d7-85f5-4e8d-8430-7156f66a2bfc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:14.202343 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c86c3d7-85f5-4e8d-8430-7156f66a2bfc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:14.202771 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c86c3d7-85f5-4e8d-8430-7156f66a2bfc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:14.255693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1413b6be-c3e3-4951-aaaa-8529690ac418 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:14.256443 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1413b6be-c3e3-4951-aaaa-8529690ac418 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:14.264982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1413b6be-c3e3-4951-aaaa-8529690ac418 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:14.265415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1413b6be-c3e3-4951-aaaa-8529690ac418 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:14.266210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1413b6be-c3e3-4951-aaaa-8529690ac418 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:14.266650 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1413b6be-c3e3-4951-aaaa-8529690ac418 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:14.335355 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1413b6be-c3e3-4951-aaaa-8529690ac418 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:14.343804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1413b6be-c3e3-4951-aaaa-8529690ac418 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093681 Jul 04 06:16:14.344381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 996/1974] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:14 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:14.350949 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1c86c3d7-85f5-4e8d-8430-7156f66a2bfc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:14.359598 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1c86c3d7-85f5-4e8d-8430-7156f66a2bfc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.175429 Jul 04 06:16:14.360154 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 979/1975] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:14 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:15.363988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d6ff8522-ce83-4c60-b35b-6a47879901f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:15.364946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d6ff8522-ce83-4c60-b35b-6a47879901f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:15.373809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6ff8522-ce83-4c60-b35b-6a47879901f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:15.374263 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6ff8522-ce83-4c60-b35b-6a47879901f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:15.375037 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6ff8522-ce83-4c60-b35b-6a47879901f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:15.375505 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6ff8522-ce83-4c60-b35b-6a47879901f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:15.376564 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d0957e17-a88b-46cc-9fce-d2122271eeae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:15.377168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d0957e17-a88b-46cc-9fce-d2122271eeae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:15.384156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0957e17-a88b-46cc-9fce-d2122271eeae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:15.384586 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0957e17-a88b-46cc-9fce-d2122271eeae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:15.385381 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0957e17-a88b-46cc-9fce-d2122271eeae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:15.385819 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0957e17-a88b-46cc-9fce-d2122271eeae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:15.438112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d6ff8522-ce83-4c60-b35b-6a47879901f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:15.446406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d6ff8522-ce83-4c60-b35b-6a47879901f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089103 Jul 04 06:16:15.447018 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 997/1976] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:15.515960 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d0957e17-a88b-46cc-9fce-d2122271eeae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:15.527203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d0957e17-a88b-46cc-9fce-d2122271eeae tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.154478 Jul 04 06:16:15.528835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 980/1977] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:15 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:16.467194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ed318efd-8db2-4853-9040-57a82e1253ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:16.468261 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ed318efd-8db2-4853-9040-57a82e1253ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:16.479520 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed318efd-8db2-4853-9040-57a82e1253ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:16.479982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed318efd-8db2-4853-9040-57a82e1253ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:16.480760 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed318efd-8db2-4853-9040-57a82e1253ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:16.481199 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ed318efd-8db2-4853-9040-57a82e1253ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:16.543517 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ed318efd-8db2-4853-9040-57a82e1253ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:16.547575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d87814b0-64c8-4ecc-9021-803f23ca5f89 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:16.548249 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d87814b0-64c8-4ecc-9021-803f23ca5f89 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:16.551962 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ed318efd-8db2-4853-9040-57a82e1253ca tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091213 Jul 04 06:16:16.552526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 998/1978] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:16.555006 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d87814b0-64c8-4ecc-9021-803f23ca5f89 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:16.555487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d87814b0-64c8-4ecc-9021-803f23ca5f89 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:16.556255 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d87814b0-64c8-4ecc-9021-803f23ca5f89 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:16.556843 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d87814b0-64c8-4ecc-9021-803f23ca5f89 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:16.700358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d87814b0-64c8-4ecc-9021-803f23ca5f89 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:16.708733 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d87814b0-64c8-4ecc-9021-803f23ca5f89 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165113 Jul 04 06:16:16.709345 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 981/1979] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:16 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:17.570880 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1f49b0be-cf15-406c-a9fb-9aa68063607a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:17.571719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1f49b0be-cf15-406c-a9fb-9aa68063607a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:17.581069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f49b0be-cf15-406c-a9fb-9aa68063607a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:17.581713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f49b0be-cf15-406c-a9fb-9aa68063607a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:17.583017 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f49b0be-cf15-406c-a9fb-9aa68063607a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:17.583641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f49b0be-cf15-406c-a9fb-9aa68063607a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:17.648243 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f49b0be-cf15-406c-a9fb-9aa68063607a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:17.657781 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f49b0be-cf15-406c-a9fb-9aa68063607a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092065 Jul 04 06:16:17.658340 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 999/1980] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:17.730207 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6bca03ee-c5e5-4b44-9cd3-a92a5f773717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:17.731170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6bca03ee-c5e5-4b44-9cd3-a92a5f773717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:17.742101 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bca03ee-c5e5-4b44-9cd3-a92a5f773717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:17.742855 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bca03ee-c5e5-4b44-9cd3-a92a5f773717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:17.744181 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bca03ee-c5e5-4b44-9cd3-a92a5f773717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:17.744914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bca03ee-c5e5-4b44-9cd3-a92a5f773717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:17.878284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6bca03ee-c5e5-4b44-9cd3-a92a5f773717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:17.888846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6bca03ee-c5e5-4b44-9cd3-a92a5f773717 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.165203 Jul 04 06:16:17.889413 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 982/1981] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:17 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:18.675741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b4b13644-fda6-46fb-a2be-a8f16d00ea59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:18.676533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b4b13644-fda6-46fb-a2be-a8f16d00ea59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:18.684996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4b13644-fda6-46fb-a2be-a8f16d00ea59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:18.685561 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4b13644-fda6-46fb-a2be-a8f16d00ea59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:18.686523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4b13644-fda6-46fb-a2be-a8f16d00ea59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:18.687068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4b13644-fda6-46fb-a2be-a8f16d00ea59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:18.753818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b4b13644-fda6-46fb-a2be-a8f16d00ea59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:18.764710 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b4b13644-fda6-46fb-a2be-a8f16d00ea59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093912 Jul 04 06:16:18.765292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1000/1982] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:18.910576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c63e5ad-0dd0-46b1-bd2d-426b78ae9bcd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:18.911524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9c63e5ad-0dd0-46b1-bd2d-426b78ae9bcd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:18.920496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c63e5ad-0dd0-46b1-bd2d-426b78ae9bcd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:18.920937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c63e5ad-0dd0-46b1-bd2d-426b78ae9bcd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:18.921720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c63e5ad-0dd0-46b1-bd2d-426b78ae9bcd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:18.922144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c63e5ad-0dd0-46b1-bd2d-426b78ae9bcd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:19.060783 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9c63e5ad-0dd0-46b1-bd2d-426b78ae9bcd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:19.073196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9c63e5ad-0dd0-46b1-bd2d-426b78ae9bcd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168886 Jul 04 06:16:19.073989 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 983/1983] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:18 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:19.786561 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ffdaa8d8-a340-4d89-bc86-2990e2e2dee1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:19.787499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ffdaa8d8-a340-4d89-bc86-2990e2e2dee1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:19.798564 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffdaa8d8-a340-4d89-bc86-2990e2e2dee1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:19.799335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffdaa8d8-a340-4d89-bc86-2990e2e2dee1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:19.800654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffdaa8d8-a340-4d89-bc86-2990e2e2dee1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:19.801399 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffdaa8d8-a340-4d89-bc86-2990e2e2dee1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:19.864739 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ffdaa8d8-a340-4d89-bc86-2990e2e2dee1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:19.873106 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ffdaa8d8-a340-4d89-bc86-2990e2e2dee1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093158 Jul 04 06:16:19.873680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1001/1984] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:20.098893 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-41f0452d-1e37-4fea-87c1-bafb7215eefd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:20.099742 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-41f0452d-1e37-4fea-87c1-bafb7215eefd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:20.108348 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41f0452d-1e37-4fea-87c1-bafb7215eefd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:20.108794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41f0452d-1e37-4fea-87c1-bafb7215eefd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:20.109553 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41f0452d-1e37-4fea-87c1-bafb7215eefd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:20.110011 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41f0452d-1e37-4fea-87c1-bafb7215eefd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:20.238322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-41f0452d-1e37-4fea-87c1-bafb7215eefd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:20.246341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-41f0452d-1e37-4fea-87c1-bafb7215eefd tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.153569 Jul 04 06:16:20.246934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 984/1985] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:20 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:20.893476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ab154f9c-919b-4c3f-bc72-02d89869ab6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:20.894363 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ab154f9c-919b-4c3f-bc72-02d89869ab6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:20.905934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab154f9c-919b-4c3f-bc72-02d89869ab6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:20.906762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab154f9c-919b-4c3f-bc72-02d89869ab6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:20.908087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab154f9c-919b-4c3f-bc72-02d89869ab6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:20.908818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab154f9c-919b-4c3f-bc72-02d89869ab6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:20.975773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ab154f9c-919b-4c3f-bc72-02d89869ab6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:20.986146 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ab154f9c-919b-4c3f-bc72-02d89869ab6a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.099463 Jul 04 06:16:20.986744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1002/1986] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:20 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:21.265325 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4dfbcccb-3b7a-4db7-b1cc-89416d2728dc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:21.266104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4dfbcccb-3b7a-4db7-b1cc-89416d2728dc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:21.274524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dfbcccb-3b7a-4db7-b1cc-89416d2728dc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:21.275086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dfbcccb-3b7a-4db7-b1cc-89416d2728dc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:21.276508 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dfbcccb-3b7a-4db7-b1cc-89416d2728dc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:21.277265 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dfbcccb-3b7a-4db7-b1cc-89416d2728dc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:21.428670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4dfbcccb-3b7a-4db7-b1cc-89416d2728dc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:21.438352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4dfbcccb-3b7a-4db7-b1cc-89416d2728dc tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.177925 Jul 04 06:16:21.438928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 985/1987] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:21 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:22.007770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b6477697-6262-4611-b80d-8c9d41846188 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:22.008752 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b6477697-6262-4611-b80d-8c9d41846188 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:22.019949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6477697-6262-4611-b80d-8c9d41846188 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:22.020683 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6477697-6262-4611-b80d-8c9d41846188 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:22.021942 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6477697-6262-4611-b80d-8c9d41846188 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:22.022659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6477697-6262-4611-b80d-8c9d41846188 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:22.087033 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b6477697-6262-4611-b80d-8c9d41846188 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:22.095892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b6477697-6262-4611-b80d-8c9d41846188 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095115 Jul 04 06:16:22.096468 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1003/1988] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:22.459665 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a2eb5a8f-3641-4f14-abf7-5e004718ef7b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:22.460596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a2eb5a8f-3641-4f14-abf7-5e004718ef7b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:22.471810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2eb5a8f-3641-4f14-abf7-5e004718ef7b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:22.472554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2eb5a8f-3641-4f14-abf7-5e004718ef7b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:22.473810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2eb5a8f-3641-4f14-abf7-5e004718ef7b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:22.474522 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2eb5a8f-3641-4f14-abf7-5e004718ef7b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:22.626145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a2eb5a8f-3641-4f14-abf7-5e004718ef7b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:22.634971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a2eb5a8f-3641-4f14-abf7-5e004718ef7b tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.181968 Jul 04 06:16:22.635576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 986/1989] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:22 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:23.112781 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9acd07d4-e16e-4217-92cc-8d794b8dc970 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:23.113482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9acd07d4-e16e-4217-92cc-8d794b8dc970 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:23.120535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9acd07d4-e16e-4217-92cc-8d794b8dc970 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:23.120987 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9acd07d4-e16e-4217-92cc-8d794b8dc970 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:23.121757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9acd07d4-e16e-4217-92cc-8d794b8dc970 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:23.122194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9acd07d4-e16e-4217-92cc-8d794b8dc970 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:23.197123 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9acd07d4-e16e-4217-92cc-8d794b8dc970 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:23.206988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9acd07d4-e16e-4217-92cc-8d794b8dc970 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097908 Jul 04 06:16:23.208425 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1004/1990] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:23.736064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9386f499-2aaa-436c-91fa-50c6a6a1b2de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:23.736733 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9386f499-2aaa-436c-91fa-50c6a6a1b2de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:23.745766 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9386f499-2aaa-436c-91fa-50c6a6a1b2de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:23.746222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9386f499-2aaa-436c-91fa-50c6a6a1b2de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:23.746987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9386f499-2aaa-436c-91fa-50c6a6a1b2de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:23.747464 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9386f499-2aaa-436c-91fa-50c6a6a1b2de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:23.877897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9386f499-2aaa-436c-91fa-50c6a6a1b2de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:23.886062 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9386f499-2aaa-436c-91fa-50c6a6a1b2de tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.236215 Jul 04 06:16:23.886635 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 987/1991] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:23 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:24.230924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c38ddfbf-be1f-4a86-8a2a-d8541a041fe7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:24.231721 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c38ddfbf-be1f-4a86-8a2a-d8541a041fe7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:24.242300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c38ddfbf-be1f-4a86-8a2a-d8541a041fe7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:24.242988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c38ddfbf-be1f-4a86-8a2a-d8541a041fe7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:24.244238 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c38ddfbf-be1f-4a86-8a2a-d8541a041fe7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:24.244902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c38ddfbf-be1f-4a86-8a2a-d8541a041fe7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:24.308173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c38ddfbf-be1f-4a86-8a2a-d8541a041fe7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:24.316269 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c38ddfbf-be1f-4a86-8a2a-d8541a041fe7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092962 Jul 04 06:16:24.316846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1005/1992] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:24.904068 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-40273ca5-0bf6-4b26-b717-f91df2f2183f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:24.904665 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-40273ca5-0bf6-4b26-b717-f91df2f2183f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:24.911600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40273ca5-0bf6-4b26-b717-f91df2f2183f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:24.912053 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40273ca5-0bf6-4b26-b717-f91df2f2183f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:24.912816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40273ca5-0bf6-4b26-b717-f91df2f2183f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:24.913249 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40273ca5-0bf6-4b26-b717-f91df2f2183f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:24.928336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:16:25.056996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-40273ca5-0bf6-4b26-b717-f91df2f2183f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:25.066158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-40273ca5-0bf6-4b26-b717-f91df2f2183f tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.166395 Jul 04 06:16:25.066901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 988/1993] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:24 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:25.333627 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0c9e64ab-ad78-477c-b8c8-060014c1f3b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:25.334264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0c9e64ab-ad78-477c-b8c8-060014c1f3b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:25.341527 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c9e64ab-ad78-477c-b8c8-060014c1f3b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:25.341974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c9e64ab-ad78-477c-b8c8-060014c1f3b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:25.342774 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c9e64ab-ad78-477c-b8c8-060014c1f3b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:25.343204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c9e64ab-ad78-477c-b8c8-060014c1f3b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:25.406234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0c9e64ab-ad78-477c-b8c8-060014c1f3b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:25.414465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0c9e64ab-ad78-477c-b8c8-060014c1f3b6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.084875 Jul 04 06:16:25.415007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1006/1994] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:26.086754 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c6465d53-dbd2-46b2-9c9c-2e1c1420bc03 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:26.087831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c6465d53-dbd2-46b2-9c9c-2e1c1420bc03 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:26.099050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6465d53-dbd2-46b2-9c9c-2e1c1420bc03 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:26.099853 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6465d53-dbd2-46b2-9c9c-2e1c1420bc03 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:26.101162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6465d53-dbd2-46b2-9c9c-2e1c1420bc03 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:26.101894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c6465d53-dbd2-46b2-9c9c-2e1c1420bc03 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:26.240747 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c6465d53-dbd2-46b2-9c9c-2e1c1420bc03 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:26.249296 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c6465d53-dbd2-46b2-9c9c-2e1c1420bc03 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.168989 Jul 04 06:16:26.249927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 989/1995] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:26 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:26.435529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb3050ad-b7c7-4002-8ebd-b0a5570e07b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:26.436457 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bb3050ad-b7c7-4002-8ebd-b0a5570e07b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:26.447413 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb3050ad-b7c7-4002-8ebd-b0a5570e07b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:26.448202 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb3050ad-b7c7-4002-8ebd-b0a5570e07b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:26.449208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb3050ad-b7c7-4002-8ebd-b0a5570e07b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:26.449643 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb3050ad-b7c7-4002-8ebd-b0a5570e07b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:26.520386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bb3050ad-b7c7-4002-8ebd-b0a5570e07b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:26.529546 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bb3050ad-b7c7-4002-8ebd-b0a5570e07b3 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.100640 Jul 04 06:16:26.530094 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1007/1996] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:27.270684 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c3ff3b90-9f3a-4010-ae79-0adb2a9b8767 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:27.271797 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c3ff3b90-9f3a-4010-ae79-0adb2a9b8767 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:27.280983 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ff3b90-9f3a-4010-ae79-0adb2a9b8767 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:27.281438 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ff3b90-9f3a-4010-ae79-0adb2a9b8767 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:27.282213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ff3b90-9f3a-4010-ae79-0adb2a9b8767 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:27.282655 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3ff3b90-9f3a-4010-ae79-0adb2a9b8767 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:27.435070 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3ff3b90-9f3a-4010-ae79-0adb2a9b8767 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:27.442571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c3ff3b90-9f3a-4010-ae79-0adb2a9b8767 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.178388 Jul 04 06:16:27.443114 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 990/1997] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:27 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:27.546202 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c222f1dd-750d-466e-9240-a7f137e5bf88 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:27.546806 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c222f1dd-750d-466e-9240-a7f137e5bf88 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:27.553811 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c222f1dd-750d-466e-9240-a7f137e5bf88 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:27.554258 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c222f1dd-750d-466e-9240-a7f137e5bf88 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:27.555024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c222f1dd-750d-466e-9240-a7f137e5bf88 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:27.555489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c222f1dd-750d-466e-9240-a7f137e5bf88 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:27.620927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c222f1dd-750d-466e-9240-a7f137e5bf88 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:27.629489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c222f1dd-750d-466e-9240-a7f137e5bf88 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087185 Jul 04 06:16:27.630071 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1008/1998] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:28.463971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-03897941-92fa-458a-b69b-f6a6cb16ac65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:28.464819 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-03897941-92fa-458a-b69b-f6a6cb16ac65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:28.475284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03897941-92fa-458a-b69b-f6a6cb16ac65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:28.476059 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03897941-92fa-458a-b69b-f6a6cb16ac65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:28.477315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03897941-92fa-458a-b69b-f6a6cb16ac65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:28.478124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03897941-92fa-458a-b69b-f6a6cb16ac65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:28.607733 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-03897941-92fa-458a-b69b-f6a6cb16ac65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:28.616365 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-03897941-92fa-458a-b69b-f6a6cb16ac65 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.158997 Jul 04 06:16:28.617123 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 991/1999] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:28 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:28.646827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ffdec16-6ee7-4850-ba11-bf61ba0b872b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:28.647439 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ffdec16-6ee7-4850-ba11-bf61ba0b872b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:28.654941 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ffdec16-6ee7-4850-ba11-bf61ba0b872b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:28.655408 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ffdec16-6ee7-4850-ba11-bf61ba0b872b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:28.656638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ffdec16-6ee7-4850-ba11-bf61ba0b872b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:28.656638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ffdec16-6ee7-4850-ba11-bf61ba0b872b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:28.733552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ffdec16-6ee7-4850-ba11-bf61ba0b872b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:28.746521 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ffdec16-6ee7-4850-ba11-bf61ba0b872b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.103446 Jul 04 06:16:28.747385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1009/2000] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:29.635603 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-71dbbf8c-f2ee-4d9b-9a0c-9b8d0230b77c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:29.636498 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-71dbbf8c-f2ee-4d9b-9a0c-9b8d0230b77c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:29.644759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71dbbf8c-f2ee-4d9b-9a0c-9b8d0230b77c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:29.645322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71dbbf8c-f2ee-4d9b-9a0c-9b8d0230b77c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:29.646271 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71dbbf8c-f2ee-4d9b-9a0c-9b8d0230b77c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:29.646811 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-71dbbf8c-f2ee-4d9b-9a0c-9b8d0230b77c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:29.763712 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-69e102c5-de31-4e8b-9189-d9c015f02096 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:29.764333 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-69e102c5-de31-4e8b-9189-d9c015f02096 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:29.770758 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69e102c5-de31-4e8b-9189-d9c015f02096 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:29.771190 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69e102c5-de31-4e8b-9189-d9c015f02096 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:29.771999 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69e102c5-de31-4e8b-9189-d9c015f02096 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:29.772430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69e102c5-de31-4e8b-9189-d9c015f02096 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:29.774973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:16:29.781826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-71dbbf8c-f2ee-4d9b-9a0c-9b8d0230b77c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:29.789849 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-71dbbf8c-f2ee-4d9b-9a0c-9b8d0230b77c tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.159178 Jul 04 06:16:29.790744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 992/2001] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:29 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:29.835431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-69e102c5-de31-4e8b-9189-d9c015f02096 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:29.843607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-69e102c5-de31-4e8b-9189-d9c015f02096 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.083879 Jul 04 06:16:29.844156 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1010/2002] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:16:30.812747 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c50fe775-accf-42fb-9a6b-dc932e64ef5a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:30.813669 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c50fe775-accf-42fb-9a6b-dc932e64ef5a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:30.824897 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c50fe775-accf-42fb-9a6b-dc932e64ef5a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:30.825673 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c50fe775-accf-42fb-9a6b-dc932e64ef5a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:30.826933 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c50fe775-accf-42fb-9a6b-dc932e64ef5a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:30.827632 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c50fe775-accf-42fb-9a6b-dc932e64ef5a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:30.860260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-21c8135c-f9a8-41a3-9df3-ce1f4ed6438c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:30.860870 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-21c8135c-f9a8-41a3-9df3-ce1f4ed6438c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:30.867809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21c8135c-f9a8-41a3-9df3-ce1f4ed6438c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:30.868259 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21c8135c-f9a8-41a3-9df3-ce1f4ed6438c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:30.869039 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21c8135c-f9a8-41a3-9df3-ce1f4ed6438c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:30.869476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21c8135c-f9a8-41a3-9df3-ce1f4ed6438c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:30.934478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-21c8135c-f9a8-41a3-9df3-ce1f4ed6438c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:30.942983 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-21c8135c-f9a8-41a3-9df3-ce1f4ed6438c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086612 Jul 04 06:16:30.943801 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1011/2003] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:30 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:30.968480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c50fe775-accf-42fb-9a6b-dc932e64ef5a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:30.976729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c50fe775-accf-42fb-9a6b-dc932e64ef5a tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.171758 Jul 04 06:16:30.977293 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 993/2004] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:30 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:31.964327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2d13ade3-fdd9-438a-b286-70e22ae8e30d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:31.965235 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2d13ade3-fdd9-438a-b286-70e22ae8e30d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:31.973325 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d13ade3-fdd9-438a-b286-70e22ae8e30d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:31.973769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d13ade3-fdd9-438a-b286-70e22ae8e30d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:31.974523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d13ade3-fdd9-438a-b286-70e22ae8e30d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:31.974945 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d13ade3-fdd9-438a-b286-70e22ae8e30d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:31.994111 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a19c404-36f2-4a02-9ddd-9457e59e0772 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:31.994704 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1a19c404-36f2-4a02-9ddd-9457e59e0772 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] [instance: 9120ac5f-6d50-4583-adae-9bc3766e686f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:32.001835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a19c404-36f2-4a02-9ddd-9457e59e0772 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:32.002291 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a19c404-36f2-4a02-9ddd-9457e59e0772 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:32.003065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a19c404-36f2-4a02-9ddd-9457e59e0772 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:32.003537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a19c404-36f2-4a02-9ddd-9457e59e0772 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:32.036287 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2d13ade3-fdd9-438a-b286-70e22ae8e30d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:32.044537 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2d13ade3-fdd9-438a-b286-70e22ae8e30d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086826 Jul 04 06:16:32.045109 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1012/2005] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:31 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:32.132616 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a19c404-36f2-4a02-9ddd-9457e59e0772 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78b454f9d0b4e99ae0425cd596f02c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ee0596be3b4648bd859293e02b1944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:32.141265 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a19c404-36f2-4a02-9ddd-9457e59e0772 tempest-VolumesSnapshotTestJSON-428638042 tempest-VolumesSnapshotTestJSON-428638042-project] 10.222.0.42 "GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f" status: 200 len: 1558 microversion: 2.1 time: 0.151062 Jul 04 06:16:32.141833 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 994/2006] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:31 2022] GET /compute/v2.1/servers/9120ac5f-6d50-4583-adae-9bc3766e686f => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:33.065911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c79c8fa6-c59f-493b-8c30-165a2fad0d67 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:33.066946 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c79c8fa6-c59f-493b-8c30-165a2fad0d67 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:33.078351 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c79c8fa6-c59f-493b-8c30-165a2fad0d67 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:33.078856 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c79c8fa6-c59f-493b-8c30-165a2fad0d67 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:33.079687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c79c8fa6-c59f-493b-8c30-165a2fad0d67 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:33.080234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c79c8fa6-c59f-493b-8c30-165a2fad0d67 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:33.147555 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c79c8fa6-c59f-493b-8c30-165a2fad0d67 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:33.156892 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c79c8fa6-c59f-493b-8c30-165a2fad0d67 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097538 Jul 04 06:16:33.157477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1013/2007] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:34.178080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0863a79-dd8c-4bc5-8c43-af15c1fa3924 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:34.179087 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f0863a79-dd8c-4bc5-8c43-af15c1fa3924 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:34.190052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0863a79-dd8c-4bc5-8c43-af15c1fa3924 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:34.190534 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0863a79-dd8c-4bc5-8c43-af15c1fa3924 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:34.191349 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0863a79-dd8c-4bc5-8c43-af15c1fa3924 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:34.191952 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0863a79-dd8c-4bc5-8c43-af15c1fa3924 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:34.265661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f0863a79-dd8c-4bc5-8c43-af15c1fa3924 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:34.274139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f0863a79-dd8c-4bc5-8c43-af15c1fa3924 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.102994 Jul 04 06:16:34.274741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 995/2008] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:35.295574 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ecf45103-b728-4e8b-a349-1b990d96069e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:35.296563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ecf45103-b728-4e8b-a349-1b990d96069e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:35.303240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecf45103-b728-4e8b-a349-1b990d96069e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:35.303714 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecf45103-b728-4e8b-a349-1b990d96069e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:35.304483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecf45103-b728-4e8b-a349-1b990d96069e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:35.304936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecf45103-b728-4e8b-a349-1b990d96069e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:35.367064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ecf45103-b728-4e8b-a349-1b990d96069e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:35.375556 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ecf45103-b728-4e8b-a349-1b990d96069e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086526 Jul 04 06:16:35.376173 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1014/2009] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:36.404411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7257282-960a-47cb-ba05-babf24142cef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:36.405366 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7257282-960a-47cb-ba05-babf24142cef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:36.413120 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7257282-960a-47cb-ba05-babf24142cef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:36.413568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7257282-960a-47cb-ba05-babf24142cef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:36.414334 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7257282-960a-47cb-ba05-babf24142cef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:36.414767 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7257282-960a-47cb-ba05-babf24142cef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:36.480925 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7257282-960a-47cb-ba05-babf24142cef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:36.489246 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7257282-960a-47cb-ba05-babf24142cef tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091947 Jul 04 06:16:36.489814 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 996/2010] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:37.513742 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4bf7b8b1-73b9-407b-a7df-a3281476064c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:37.514716 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4bf7b8b1-73b9-407b-a7df-a3281476064c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:37.522416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bf7b8b1-73b9-407b-a7df-a3281476064c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:37.522862 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bf7b8b1-73b9-407b-a7df-a3281476064c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:37.523652 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bf7b8b1-73b9-407b-a7df-a3281476064c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:37.524078 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bf7b8b1-73b9-407b-a7df-a3281476064c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:37.593876 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4bf7b8b1-73b9-407b-a7df-a3281476064c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:37.604833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4bf7b8b1-73b9-407b-a7df-a3281476064c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097378 Jul 04 06:16:37.605578 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1015/2011] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:38.626442 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba4aa45a-f4bd-4c01-9620-19be4cf3dded tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:38.627593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba4aa45a-f4bd-4c01-9620-19be4cf3dded tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:38.630104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=46 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:16:38.636266 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4aa45a-f4bd-4c01-9620-19be4cf3dded tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:38.636729 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4aa45a-f4bd-4c01-9620-19be4cf3dded tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:38.637527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4aa45a-f4bd-4c01-9620-19be4cf3dded tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:38.637974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba4aa45a-f4bd-4c01-9620-19be4cf3dded tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:38.701418 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ba4aa45a-f4bd-4c01-9620-19be4cf3dded tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:38.709821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba4aa45a-f4bd-4c01-9620-19be4cf3dded tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090288 Jul 04 06:16:38.710418 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 997/2012] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:39.732076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-adc9057c-279b-4c1d-84ea-d8cba0672a28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:39.734223 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-adc9057c-279b-4c1d-84ea-d8cba0672a28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:39.740791 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-adc9057c-279b-4c1d-84ea-d8cba0672a28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:39.741234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-adc9057c-279b-4c1d-84ea-d8cba0672a28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:39.741986 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-adc9057c-279b-4c1d-84ea-d8cba0672a28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:39.742414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-adc9057c-279b-4c1d-84ea-d8cba0672a28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:39.812791 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-adc9057c-279b-4c1d-84ea-d8cba0672a28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:39.821542 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-adc9057c-279b-4c1d-84ea-d8cba0672a28 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097154 Jul 04 06:16:39.822119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1016/2013] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:40.847058 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5259b56d-5f26-426e-a143-b2ce757baf0d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:40.847779 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5259b56d-5f26-426e-a143-b2ce757baf0d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:40.856325 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5259b56d-5f26-426e-a143-b2ce757baf0d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:40.856881 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5259b56d-5f26-426e-a143-b2ce757baf0d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:40.857827 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5259b56d-5f26-426e-a143-b2ce757baf0d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:40.858377 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5259b56d-5f26-426e-a143-b2ce757baf0d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:40.924843 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5259b56d-5f26-426e-a143-b2ce757baf0d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:40.933046 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5259b56d-5f26-426e-a143-b2ce757baf0d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092152 Jul 04 06:16:40.933617 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 998/2014] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:40 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:41.953964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5341f318-3353-4111-825c-4aaa26781b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:41.955002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5341f318-3353-4111-825c-4aaa26781b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:41.957628 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=50 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:16:41.963625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5341f318-3353-4111-825c-4aaa26781b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:41.964121 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5341f318-3353-4111-825c-4aaa26781b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:41.964978 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5341f318-3353-4111-825c-4aaa26781b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:41.965464 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5341f318-3353-4111-825c-4aaa26781b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:42.030455 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5341f318-3353-4111-825c-4aaa26781b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:42.038998 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5341f318-3353-4111-825c-4aaa26781b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091549 Jul 04 06:16:42.039620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1017/2015] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:41 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:43.060697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-674ad221-91dc-4cef-a638-72ef0a69c6c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:43.061749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-674ad221-91dc-4cef-a638-72ef0a69c6c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:43.070225 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-674ad221-91dc-4cef-a638-72ef0a69c6c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:43.070699 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-674ad221-91dc-4cef-a638-72ef0a69c6c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:43.071525 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-674ad221-91dc-4cef-a638-72ef0a69c6c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:43.071936 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-674ad221-91dc-4cef-a638-72ef0a69c6c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:43.137801 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-674ad221-91dc-4cef-a638-72ef0a69c6c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:43.147420 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-674ad221-91dc-4cef-a638-72ef0a69c6c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092944 Jul 04 06:16:43.150392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 999/2016] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:44.168958 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ab879eda-2beb-48d2-8c63-2c8b134119ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:44.169928 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ab879eda-2beb-48d2-8c63-2c8b134119ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:44.178685 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab879eda-2beb-48d2-8c63-2c8b134119ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:44.179144 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab879eda-2beb-48d2-8c63-2c8b134119ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:44.179949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab879eda-2beb-48d2-8c63-2c8b134119ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:44.180385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab879eda-2beb-48d2-8c63-2c8b134119ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:44.242021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ab879eda-2beb-48d2-8c63-2c8b134119ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:44.250717 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ab879eda-2beb-48d2-8c63-2c8b134119ce tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088414 Jul 04 06:16:44.251289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1018/2017] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:44 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:45.268524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce89597b-b08d-4402-aabf-3df3bb5c65ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:45.269200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ce89597b-b08d-4402-aabf-3df3bb5c65ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:45.277162 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce89597b-b08d-4402-aabf-3df3bb5c65ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:45.277663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce89597b-b08d-4402-aabf-3df3bb5c65ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:45.278509 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce89597b-b08d-4402-aabf-3df3bb5c65ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:45.278992 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce89597b-b08d-4402-aabf-3df3bb5c65ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:45.342533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce89597b-b08d-4402-aabf-3df3bb5c65ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:45.350985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce89597b-b08d-4402-aabf-3df3bb5c65ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086906 Jul 04 06:16:45.351608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1000/2018] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:46.371609 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e514e63f-04ea-436b-997d-4da31e4b13db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:46.372647 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e514e63f-04ea-436b-997d-4da31e4b13db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:46.383687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e514e63f-04ea-436b-997d-4da31e4b13db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:46.384423 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e514e63f-04ea-436b-997d-4da31e4b13db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:46.385681 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e514e63f-04ea-436b-997d-4da31e4b13db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:46.386400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e514e63f-04ea-436b-997d-4da31e4b13db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:46.454102 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e514e63f-04ea-436b-997d-4da31e4b13db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:46.462432 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e514e63f-04ea-436b-997d-4da31e4b13db tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097422 Jul 04 06:16:46.462997 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1019/2019] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:46 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:47.485883 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2cb1ba10-5aeb-4673-9de7-09103204477e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:47.486934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2cb1ba10-5aeb-4673-9de7-09103204477e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:47.498115 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cb1ba10-5aeb-4673-9de7-09103204477e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:47.499392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cb1ba10-5aeb-4673-9de7-09103204477e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:47.500700 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cb1ba10-5aeb-4673-9de7-09103204477e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:47.501441 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cb1ba10-5aeb-4673-9de7-09103204477e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:47.567437 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2cb1ba10-5aeb-4673-9de7-09103204477e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:47.575697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2cb1ba10-5aeb-4673-9de7-09103204477e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098275 Jul 04 06:16:47.576276 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1001/2020] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:48.593178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eddac40b-852f-4bed-949b-5a951ba2d22d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:48.593779 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eddac40b-852f-4bed-949b-5a951ba2d22d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:48.600864 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eddac40b-852f-4bed-949b-5a951ba2d22d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:48.601315 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eddac40b-852f-4bed-949b-5a951ba2d22d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:48.602085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eddac40b-852f-4bed-949b-5a951ba2d22d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:48.602523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eddac40b-852f-4bed-949b-5a951ba2d22d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:48.663950 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eddac40b-852f-4bed-949b-5a951ba2d22d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:48.672232 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eddac40b-852f-4bed-949b-5a951ba2d22d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.082953 Jul 04 06:16:48.672809 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1020/2021] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:49.692505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e9800a0-cd6c-4239-9701-9fdd7381ebd7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:49.693145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4e9800a0-cd6c-4239-9701-9fdd7381ebd7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:49.700891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e9800a0-cd6c-4239-9701-9fdd7381ebd7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:49.701388 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e9800a0-cd6c-4239-9701-9fdd7381ebd7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:49.702234 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e9800a0-cd6c-4239-9701-9fdd7381ebd7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:49.702713 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e9800a0-cd6c-4239-9701-9fdd7381ebd7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:49.768609 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4e9800a0-cd6c-4239-9701-9fdd7381ebd7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:49.777290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4e9800a0-cd6c-4239-9701-9fdd7381ebd7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090784 Jul 04 06:16:49.777798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1002/2022] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:50.799035 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e0db72e-e1ea-4139-87ed-50b854c520ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:50.799940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e0db72e-e1ea-4139-87ed-50b854c520ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:50.808003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e0db72e-e1ea-4139-87ed-50b854c520ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:50.808504 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e0db72e-e1ea-4139-87ed-50b854c520ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:50.809356 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e0db72e-e1ea-4139-87ed-50b854c520ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:50.809832 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e0db72e-e1ea-4139-87ed-50b854c520ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:50.880448 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e0db72e-e1ea-4139-87ed-50b854c520ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:50.889396 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e0db72e-e1ea-4139-87ed-50b854c520ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097290 Jul 04 06:16:50.890011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1021/2023] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:50 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:51.910918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb767290-f3f7-4342-b7af-82944bc89e1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:51.911618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb767290-f3f7-4342-b7af-82944bc89e1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:51.919519 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb767290-f3f7-4342-b7af-82944bc89e1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:51.920044 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb767290-f3f7-4342-b7af-82944bc89e1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:51.920939 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb767290-f3f7-4342-b7af-82944bc89e1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:51.921446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb767290-f3f7-4342-b7af-82944bc89e1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:51.988972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb767290-f3f7-4342-b7af-82944bc89e1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:51.997307 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb767290-f3f7-4342-b7af-82944bc89e1d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092956 Jul 04 06:16:51.997878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1003/2024] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:51 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:53.018841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f6cdbba9-6f69-4887-9f7a-f4f8a62d1d27 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:53.019886 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f6cdbba9-6f69-4887-9f7a-f4f8a62d1d27 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:53.028177 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6cdbba9-6f69-4887-9f7a-f4f8a62d1d27 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:53.028708 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6cdbba9-6f69-4887-9f7a-f4f8a62d1d27 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:53.029611 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6cdbba9-6f69-4887-9f7a-f4f8a62d1d27 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:53.030120 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6cdbba9-6f69-4887-9f7a-f4f8a62d1d27 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:53.106940 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f6cdbba9-6f69-4887-9f7a-f4f8a62d1d27 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:53.115301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f6cdbba9-6f69-4887-9f7a-f4f8a62d1d27 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.103102 Jul 04 06:16:53.115900 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1022/2025] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:53 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:54.136629 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6695e251-e8a0-46b7-bb00-1bc78c264884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:54.137626 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6695e251-e8a0-46b7-bb00-1bc78c264884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:54.148752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6695e251-e8a0-46b7-bb00-1bc78c264884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:54.149937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6695e251-e8a0-46b7-bb00-1bc78c264884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:54.151235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6695e251-e8a0-46b7-bb00-1bc78c264884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:54.152016 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6695e251-e8a0-46b7-bb00-1bc78c264884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:54.218748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6695e251-e8a0-46b7-bb00-1bc78c264884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:54.228306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6695e251-e8a0-46b7-bb00-1bc78c264884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098346 Jul 04 06:16:54.228884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1004/2026] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:55.247467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9cf1ff7b-aead-4852-a229-91b64c2cad01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:55.248268 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9cf1ff7b-aead-4852-a229-91b64c2cad01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:55.257418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cf1ff7b-aead-4852-a229-91b64c2cad01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:55.258014 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cf1ff7b-aead-4852-a229-91b64c2cad01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:55.259026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cf1ff7b-aead-4852-a229-91b64c2cad01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:55.259640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cf1ff7b-aead-4852-a229-91b64c2cad01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:55.327122 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9cf1ff7b-aead-4852-a229-91b64c2cad01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:55.335738 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9cf1ff7b-aead-4852-a229-91b64c2cad01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093564 Jul 04 06:16:55.336317 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1023/2027] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:56.356959 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4be37cd5-992f-4c26-addc-3949794cb00f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:56.357995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4be37cd5-992f-4c26-addc-3949794cb00f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:56.369068 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4be37cd5-992f-4c26-addc-3949794cb00f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:56.369812 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4be37cd5-992f-4c26-addc-3949794cb00f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:56.371084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4be37cd5-992f-4c26-addc-3949794cb00f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:56.371861 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4be37cd5-992f-4c26-addc-3949794cb00f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:56.376055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:16:56.437344 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4be37cd5-992f-4c26-addc-3949794cb00f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:56.445617 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4be37cd5-992f-4c26-addc-3949794cb00f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095213 Jul 04 06:16:56.446187 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1005/2028] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:56 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:57.466953 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a6220daa-e9bc-4198-96b4-807359fffe84 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:57.467968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a6220daa-e9bc-4198-96b4-807359fffe84 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:57.479131 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6220daa-e9bc-4198-96b4-807359fffe84 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:57.479932 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6220daa-e9bc-4198-96b4-807359fffe84 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:57.481198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6220daa-e9bc-4198-96b4-807359fffe84 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:57.481930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6220daa-e9bc-4198-96b4-807359fffe84 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:57.549038 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a6220daa-e9bc-4198-96b4-807359fffe84 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:57.557562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a6220daa-e9bc-4198-96b4-807359fffe84 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097142 Jul 04 06:16:57.558145 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1024/2029] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:57 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:58.576650 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d1a7bb9c-92f5-4b24-8591-1ef8aff8657e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:58.577447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d1a7bb9c-92f5-4b24-8591-1ef8aff8657e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:58.586340 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1a7bb9c-92f5-4b24-8591-1ef8aff8657e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:58.586934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1a7bb9c-92f5-4b24-8591-1ef8aff8657e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:58.588005 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1a7bb9c-92f5-4b24-8591-1ef8aff8657e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:58.588601 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1a7bb9c-92f5-4b24-8591-1ef8aff8657e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:58.653742 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d1a7bb9c-92f5-4b24-8591-1ef8aff8657e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:58.664251 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d1a7bb9c-92f5-4b24-8591-1ef8aff8657e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092717 Jul 04 06:16:58.664826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1006/2030] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:16:59.685991 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-791b7d4e-c8e9-4c13-87eb-23efa240c509 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:16:59.686855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-791b7d4e-c8e9-4c13-87eb-23efa240c509 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:16:59.697927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-791b7d4e-c8e9-4c13-87eb-23efa240c509 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:59.698665 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-791b7d4e-c8e9-4c13-87eb-23efa240c509 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:59.699954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-791b7d4e-c8e9-4c13-87eb-23efa240c509 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:16:59.700730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-791b7d4e-c8e9-4c13-87eb-23efa240c509 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:16:59.775020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-791b7d4e-c8e9-4c13-87eb-23efa240c509 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:16:59.783416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-791b7d4e-c8e9-4c13-87eb-23efa240c509 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.104455 Jul 04 06:16:59.783985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1025/2031] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:16:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:00.804685 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b943dd2b-5d29-46ab-aaf4-7ec73df588fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:00.805693 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b943dd2b-5d29-46ab-aaf4-7ec73df588fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:00.816916 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b943dd2b-5d29-46ab-aaf4-7ec73df588fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:00.817371 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b943dd2b-5d29-46ab-aaf4-7ec73df588fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:00.818141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b943dd2b-5d29-46ab-aaf4-7ec73df588fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:00.818576 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b943dd2b-5d29-46ab-aaf4-7ec73df588fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:00.900873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b943dd2b-5d29-46ab-aaf4-7ec73df588fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:00.909039 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b943dd2b-5d29-46ab-aaf4-7ec73df588fa tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.111054 Jul 04 06:17:00.909605 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1007/2032] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:00 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:01.926979 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-95663222-213d-4261-95e6-f0bb590292bc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:01.927620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-95663222-213d-4261-95e6-f0bb590292bc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:01.934982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95663222-213d-4261-95e6-f0bb590292bc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:01.935459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95663222-213d-4261-95e6-f0bb590292bc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:01.936254 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95663222-213d-4261-95e6-f0bb590292bc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:01.936658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95663222-213d-4261-95e6-f0bb590292bc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:01.939176 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=96 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:17:02.004507 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-95663222-213d-4261-95e6-f0bb590292bc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:02.016831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-95663222-213d-4261-95e6-f0bb590292bc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093570 Jul 04 06:17:02.017612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1026/2033] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:01 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:03.041248 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f28f633-5f57-46fa-a395-0372b3945540 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:03.042447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9f28f633-5f57-46fa-a395-0372b3945540 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:03.054060 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f28f633-5f57-46fa-a395-0372b3945540 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:03.054546 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f28f633-5f57-46fa-a395-0372b3945540 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:03.055365 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f28f633-5f57-46fa-a395-0372b3945540 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:03.055806 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f28f633-5f57-46fa-a395-0372b3945540 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:03.121983 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9f28f633-5f57-46fa-a395-0372b3945540 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:03.130029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9f28f633-5f57-46fa-a395-0372b3945540 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095472 Jul 04 06:17:03.130561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1008/2034] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:04.152289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42ccb61d-dd43-4333-bcf4-3455e1d474bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:04.153295 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-42ccb61d-dd43-4333-bcf4-3455e1d474bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:04.162968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42ccb61d-dd43-4333-bcf4-3455e1d474bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:04.163465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42ccb61d-dd43-4333-bcf4-3455e1d474bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:04.164296 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42ccb61d-dd43-4333-bcf4-3455e1d474bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:04.164757 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42ccb61d-dd43-4333-bcf4-3455e1d474bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:04.238234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-42ccb61d-dd43-4333-bcf4-3455e1d474bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:04.246810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-42ccb61d-dd43-4333-bcf4-3455e1d474bb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.101786 Jul 04 06:17:04.247405 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1027/2035] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:05.268086 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a4679672-48cd-4900-b162-81da273f0d54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:05.269026 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a4679672-48cd-4900-b162-81da273f0d54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:05.277049 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4679672-48cd-4900-b162-81da273f0d54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:05.277500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4679672-48cd-4900-b162-81da273f0d54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:05.278293 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4679672-48cd-4900-b162-81da273f0d54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:05.278725 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4679672-48cd-4900-b162-81da273f0d54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:05.340822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a4679672-48cd-4900-b162-81da273f0d54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:05.348886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a4679672-48cd-4900-b162-81da273f0d54 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087471 Jul 04 06:17:05.349423 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1009/2036] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:05 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:06.374116 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7693039b-9d98-4115-a99f-5b6f24c9342a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:06.375127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7693039b-9d98-4115-a99f-5b6f24c9342a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:06.384370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7693039b-9d98-4115-a99f-5b6f24c9342a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:06.384825 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7693039b-9d98-4115-a99f-5b6f24c9342a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:06.385602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7693039b-9d98-4115-a99f-5b6f24c9342a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:06.386030 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7693039b-9d98-4115-a99f-5b6f24c9342a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:06.703886 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7693039b-9d98-4115-a99f-5b6f24c9342a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:06.712412 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7693039b-9d98-4115-a99f-5b6f24c9342a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.344945 Jul 04 06:17:06.712993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1028/2037] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:07.732946 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4fd4135e-6a61-4108-a226-42f50dde8d55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:07.733967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4fd4135e-6a61-4108-a226-42f50dde8d55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:07.742764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fd4135e-6a61-4108-a226-42f50dde8d55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:07.743214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fd4135e-6a61-4108-a226-42f50dde8d55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:07.744011 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fd4135e-6a61-4108-a226-42f50dde8d55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:07.744474 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fd4135e-6a61-4108-a226-42f50dde8d55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:07.815597 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4fd4135e-6a61-4108-a226-42f50dde8d55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:07.824175 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4fd4135e-6a61-4108-a226-42f50dde8d55 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097681 Jul 04 06:17:07.824742 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1010/2038] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:08.844984 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0db61722-1cb6-48d5-820a-2128203d9091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:08.845884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0db61722-1cb6-48d5-820a-2128203d9091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:08.854021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0db61722-1cb6-48d5-820a-2128203d9091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:08.854493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0db61722-1cb6-48d5-820a-2128203d9091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:08.855291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0db61722-1cb6-48d5-820a-2128203d9091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:08.855725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0db61722-1cb6-48d5-820a-2128203d9091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:08.927639 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0db61722-1cb6-48d5-820a-2128203d9091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:08.936174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0db61722-1cb6-48d5-820a-2128203d9091 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097764 Jul 04 06:17:08.936741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1029/2039] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:08 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:09.957409 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-79e83a51-a830-4551-bc71-ad28356045f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:09.958375 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-79e83a51-a830-4551-bc71-ad28356045f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:09.960896 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=28 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:17:09.967083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79e83a51-a830-4551-bc71-ad28356045f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:09.967553 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79e83a51-a830-4551-bc71-ad28356045f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:09.968324 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79e83a51-a830-4551-bc71-ad28356045f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:09.968762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79e83a51-a830-4551-bc71-ad28356045f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:10.040327 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-79e83a51-a830-4551-bc71-ad28356045f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:10.048481 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-79e83a51-a830-4551-bc71-ad28356045f7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097844 Jul 04 06:17:10.049050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1011/2040] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:11.064985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2701ccb9-8c36-4e16-8232-4c19839bc884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:11.065661 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2701ccb9-8c36-4e16-8232-4c19839bc884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:11.072679 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2701ccb9-8c36-4e16-8232-4c19839bc884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:11.073108 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2701ccb9-8c36-4e16-8232-4c19839bc884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:11.073879 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2701ccb9-8c36-4e16-8232-4c19839bc884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:11.074319 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2701ccb9-8c36-4e16-8232-4c19839bc884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:11.144894 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2701ccb9-8c36-4e16-8232-4c19839bc884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:11.158264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2701ccb9-8c36-4e16-8232-4c19839bc884 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096946 Jul 04 06:17:11.159284 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1030/2041] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:11 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:12.179854 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8568d393-6e84-4f3b-8587-8baf624f5ce6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:12.180502 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8568d393-6e84-4f3b-8587-8baf624f5ce6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:12.187375 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8568d393-6e84-4f3b-8587-8baf624f5ce6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:12.187821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8568d393-6e84-4f3b-8587-8baf624f5ce6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:12.188578 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8568d393-6e84-4f3b-8587-8baf624f5ce6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:12.188987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8568d393-6e84-4f3b-8587-8baf624f5ce6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:12.250931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8568d393-6e84-4f3b-8587-8baf624f5ce6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:12.259486 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8568d393-6e84-4f3b-8587-8baf624f5ce6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085201 Jul 04 06:17:12.260051 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1012/2042] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:12 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:13.276825 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5816c346-2271-4636-8385-204effdb4171 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:13.277429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5816c346-2271-4636-8385-204effdb4171 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:13.279826 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=28 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:17:13.285300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5816c346-2271-4636-8385-204effdb4171 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:13.285749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5816c346-2271-4636-8385-204effdb4171 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:13.286525 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5816c346-2271-4636-8385-204effdb4171 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:13.286962 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5816c346-2271-4636-8385-204effdb4171 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:13.355095 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5816c346-2271-4636-8385-204effdb4171 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:13.367457 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5816c346-2271-4636-8385-204effdb4171 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094608 Jul 04 06:17:13.368378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1031/2043] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:13 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:14.388928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-729a7f85-9e1a-48d9-94a5-a0e0b2367ad4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:14.389921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-729a7f85-9e1a-48d9-94a5-a0e0b2367ad4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:14.399607 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-729a7f85-9e1a-48d9-94a5-a0e0b2367ad4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:14.400055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-729a7f85-9e1a-48d9-94a5-a0e0b2367ad4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:14.400814 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-729a7f85-9e1a-48d9-94a5-a0e0b2367ad4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:14.401242 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-729a7f85-9e1a-48d9-94a5-a0e0b2367ad4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:14.473134 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-729a7f85-9e1a-48d9-94a5-a0e0b2367ad4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:14.483287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-729a7f85-9e1a-48d9-94a5-a0e0b2367ad4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.100865 Jul 04 06:17:14.484035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1013/2044] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:14 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:15.504745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e789695-b500-4d8f-ad41-c4cdef18bc9c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:15.505679 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e789695-b500-4d8f-ad41-c4cdef18bc9c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:15.513502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e789695-b500-4d8f-ad41-c4cdef18bc9c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:15.513960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e789695-b500-4d8f-ad41-c4cdef18bc9c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:15.514733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e789695-b500-4d8f-ad41-c4cdef18bc9c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:15.515168 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e789695-b500-4d8f-ad41-c4cdef18bc9c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:15.580162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e789695-b500-4d8f-ad41-c4cdef18bc9c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:15.588451 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e789695-b500-4d8f-ad41-c4cdef18bc9c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090283 Jul 04 06:17:15.589030 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1032/2045] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:16.609558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-34ddca68-073e-4480-ac89-890f90ff7cb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:16.610530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-34ddca68-073e-4480-ac89-890f90ff7cb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:16.619869 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34ddca68-073e-4480-ac89-890f90ff7cb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:16.620313 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34ddca68-073e-4480-ac89-890f90ff7cb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:16.621085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34ddca68-073e-4480-ac89-890f90ff7cb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:16.621521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34ddca68-073e-4480-ac89-890f90ff7cb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:16.689772 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-34ddca68-073e-4480-ac89-890f90ff7cb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:16.698043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-34ddca68-073e-4480-ac89-890f90ff7cb0 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095000 Jul 04 06:17:16.698616 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1014/2046] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:17.718545 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-445eb56a-0367-4643-bb7a-f90263ea3980 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:17.719462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-445eb56a-0367-4643-bb7a-f90263ea3980 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:17.729141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-445eb56a-0367-4643-bb7a-f90263ea3980 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:17.729595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-445eb56a-0367-4643-bb7a-f90263ea3980 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:17.730381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-445eb56a-0367-4643-bb7a-f90263ea3980 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:17.730813 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-445eb56a-0367-4643-bb7a-f90263ea3980 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:17.804088 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-445eb56a-0367-4643-bb7a-f90263ea3980 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:17.818415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-445eb56a-0367-4643-bb7a-f90263ea3980 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.105980 Jul 04 06:17:17.819213 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1033/2047] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:18.836292 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-87e2fbae-472f-4632-b9b1-0307ebb6d6c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:18.837298 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-87e2fbae-472f-4632-b9b1-0307ebb6d6c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:18.848145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87e2fbae-472f-4632-b9b1-0307ebb6d6c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:18.848594 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87e2fbae-472f-4632-b9b1-0307ebb6d6c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:18.849373 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87e2fbae-472f-4632-b9b1-0307ebb6d6c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:18.849803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87e2fbae-472f-4632-b9b1-0307ebb6d6c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:18.916634 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87e2fbae-472f-4632-b9b1-0307ebb6d6c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:18.924600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-87e2fbae-472f-4632-b9b1-0307ebb6d6c4 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092309 Jul 04 06:17:18.925163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1015/2048] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:19.947283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8fcada0e-e18f-4ed9-bf7f-efe9bcbe0d0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:19.948028 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8fcada0e-e18f-4ed9-bf7f-efe9bcbe0d0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:19.955988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fcada0e-e18f-4ed9-bf7f-efe9bcbe0d0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:19.956510 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fcada0e-e18f-4ed9-bf7f-efe9bcbe0d0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:19.957402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fcada0e-e18f-4ed9-bf7f-efe9bcbe0d0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:19.957909 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fcada0e-e18f-4ed9-bf7f-efe9bcbe0d0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:20.021182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8fcada0e-e18f-4ed9-bf7f-efe9bcbe0d0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:20.032447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8fcada0e-e18f-4ed9-bf7f-efe9bcbe0d0c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091050 Jul 04 06:17:20.033189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1034/2049] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:21.053918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ad0dbe2-db2b-4f20-b40a-4af3598b661f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:21.054927 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ad0dbe2-db2b-4f20-b40a-4af3598b661f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:21.061849 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ad0dbe2-db2b-4f20-b40a-4af3598b661f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:21.062297 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ad0dbe2-db2b-4f20-b40a-4af3598b661f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:21.063062 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ad0dbe2-db2b-4f20-b40a-4af3598b661f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:21.063532 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ad0dbe2-db2b-4f20-b40a-4af3598b661f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:21.131136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ad0dbe2-db2b-4f20-b40a-4af3598b661f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:21.143075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ad0dbe2-db2b-4f20-b40a-4af3598b661f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095599 Jul 04 06:17:21.143816 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1016/2050] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:21 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:22.162535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eadd2337-712f-46ec-ba52-f47ac6f879ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:22.163124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eadd2337-712f-46ec-ba52-f47ac6f879ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:22.170015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eadd2337-712f-46ec-ba52-f47ac6f879ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:22.170467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eadd2337-712f-46ec-ba52-f47ac6f879ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:22.171221 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eadd2337-712f-46ec-ba52-f47ac6f879ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:22.171694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eadd2337-712f-46ec-ba52-f47ac6f879ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:22.237583 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eadd2337-712f-46ec-ba52-f47ac6f879ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:22.246364 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eadd2337-712f-46ec-ba52-f47ac6f879ed tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087808 Jul 04 06:17:22.246927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1035/2051] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:22 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:17:23.267317 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3dcd5df5-d2ca-4c20-a79c-ff24655cee5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:23.268376 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3dcd5df5-d2ca-4c20-a79c-ff24655cee5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:23.279028 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dcd5df5-d2ca-4c20-a79c-ff24655cee5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:23.279516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dcd5df5-d2ca-4c20-a79c-ff24655cee5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:23.280283 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dcd5df5-d2ca-4c20-a79c-ff24655cee5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:23.280717 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dcd5df5-d2ca-4c20-a79c-ff24655cee5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:23.352336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3dcd5df5-d2ca-4c20-a79c-ff24655cee5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:23.360646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3dcd5df5-d2ca-4c20-a79c-ff24655cee5a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.099857 Jul 04 06:17:23.361221 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1017/2052] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:23 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:24.380996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a9b8c7c6-cdea-455c-a125-f51da39d857d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:24.381964 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a9b8c7c6-cdea-455c-a125-f51da39d857d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:24.390344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9b8c7c6-cdea-455c-a125-f51da39d857d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:24.390798 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9b8c7c6-cdea-455c-a125-f51da39d857d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:24.391607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9b8c7c6-cdea-455c-a125-f51da39d857d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:24.392043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9b8c7c6-cdea-455c-a125-f51da39d857d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:24.458576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a9b8c7c6-cdea-455c-a125-f51da39d857d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:24.467096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a9b8c7c6-cdea-455c-a125-f51da39d857d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092633 Jul 04 06:17:24.467827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1036/2053] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:24 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:25.488557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7044e2ce-961c-4c1f-a775-a2e5e39278a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:25.489528 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7044e2ce-961c-4c1f-a775-a2e5e39278a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:25.498967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7044e2ce-961c-4c1f-a775-a2e5e39278a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:25.499453 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7044e2ce-961c-4c1f-a775-a2e5e39278a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:25.500218 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7044e2ce-961c-4c1f-a775-a2e5e39278a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:25.500647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7044e2ce-961c-4c1f-a775-a2e5e39278a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:25.562614 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7044e2ce-961c-4c1f-a775-a2e5e39278a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:25.571165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7044e2ce-961c-4c1f-a775-a2e5e39278a7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089178 Jul 04 06:17:25.571809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1018/2054] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:25 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:25.749655 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:17:25.750010 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:17:26.592482 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a42f072-a08d-407a-adce-d4f49d0ef76e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:26.593691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a42f072-a08d-407a-adce-d4f49d0ef76e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:26.604905 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a42f072-a08d-407a-adce-d4f49d0ef76e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:26.605361 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a42f072-a08d-407a-adce-d4f49d0ef76e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:26.606127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a42f072-a08d-407a-adce-d4f49d0ef76e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:26.606563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a42f072-a08d-407a-adce-d4f49d0ef76e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:26.670204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1a42f072-a08d-407a-adce-d4f49d0ef76e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:26.682371 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a42f072-a08d-407a-adce-d4f49d0ef76e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096273 Jul 04 06:17:26.683288 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1037/2055] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:26 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:27.703681 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-14f49444-abb6-4fb3-b6a9-0a29353adc1e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:27.704280 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-14f49444-abb6-4fb3-b6a9-0a29353adc1e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:27.711669 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14f49444-abb6-4fb3-b6a9-0a29353adc1e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:27.712181 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14f49444-abb6-4fb3-b6a9-0a29353adc1e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:27.713021 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14f49444-abb6-4fb3-b6a9-0a29353adc1e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:27.713473 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14f49444-abb6-4fb3-b6a9-0a29353adc1e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:27.716170 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=84 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:17:27.789362 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-14f49444-abb6-4fb3-b6a9-0a29353adc1e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:27.797562 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-14f49444-abb6-4fb3-b6a9-0a29353adc1e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098269 Jul 04 06:17:27.798151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1019/2056] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:27 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:28.817618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8521fc1c-2396-4721-a011-07518285b976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:28.818196 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8521fc1c-2396-4721-a011-07518285b976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:28.826660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8521fc1c-2396-4721-a011-07518285b976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:28.827106 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8521fc1c-2396-4721-a011-07518285b976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:28.827915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8521fc1c-2396-4721-a011-07518285b976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:28.828350 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8521fc1c-2396-4721-a011-07518285b976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:28.900740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8521fc1c-2396-4721-a011-07518285b976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:28.910463 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8521fc1c-2396-4721-a011-07518285b976 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.099197 Jul 04 06:17:28.911043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1038/2057] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:28 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:29.929074 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b30a001c-eaa6-493b-89bc-b90c9f0453cb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:29.929744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b30a001c-eaa6-493b-89bc-b90c9f0453cb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:29.936985 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b30a001c-eaa6-493b-89bc-b90c9f0453cb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:29.937437 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b30a001c-eaa6-493b-89bc-b90c9f0453cb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:29.938241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b30a001c-eaa6-493b-89bc-b90c9f0453cb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:29.938674 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b30a001c-eaa6-493b-89bc-b90c9f0453cb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:30.008406 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b30a001c-eaa6-493b-89bc-b90c9f0453cb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:30.017029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b30a001c-eaa6-493b-89bc-b90c9f0453cb tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092445 Jul 04 06:17:30.017595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1020/2058] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:29 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:31.037688 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4ff3602e-7a86-4bb3-b414-87d2c6eaa9ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:31.038643 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4ff3602e-7a86-4bb3-b414-87d2c6eaa9ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:31.047278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ff3602e-7a86-4bb3-b414-87d2c6eaa9ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:31.047754 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ff3602e-7a86-4bb3-b414-87d2c6eaa9ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:31.048666 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ff3602e-7a86-4bb3-b414-87d2c6eaa9ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:31.049199 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ff3602e-7a86-4bb3-b414-87d2c6eaa9ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:31.117869 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4ff3602e-7a86-4bb3-b414-87d2c6eaa9ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:31.126690 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4ff3602e-7a86-4bb3-b414-87d2c6eaa9ea tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095561 Jul 04 06:17:31.127723 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1039/2059] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:31 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:32.147515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4784e11d-2704-48fb-aa20-3a562b0deb59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:32.148458 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4784e11d-2704-48fb-aa20-3a562b0deb59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:32.156584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4784e11d-2704-48fb-aa20-3a562b0deb59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:32.157027 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4784e11d-2704-48fb-aa20-3a562b0deb59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:32.157781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4784e11d-2704-48fb-aa20-3a562b0deb59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:32.158211 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4784e11d-2704-48fb-aa20-3a562b0deb59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:32.226704 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4784e11d-2704-48fb-aa20-3a562b0deb59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:32.235174 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4784e11d-2704-48fb-aa20-3a562b0deb59 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093726 Jul 04 06:17:32.235733 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1021/2060] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:32 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:33.255232 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a180390b-401e-4654-af8b-fdbcb96a3adc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:33.256121 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a180390b-401e-4654-af8b-fdbcb96a3adc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:33.264404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a180390b-401e-4654-af8b-fdbcb96a3adc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:33.264867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a180390b-401e-4654-af8b-fdbcb96a3adc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:33.265635 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a180390b-401e-4654-af8b-fdbcb96a3adc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:33.266069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a180390b-401e-4654-af8b-fdbcb96a3adc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:33.268626 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=84 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:17:33.336719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a180390b-401e-4654-af8b-fdbcb96a3adc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:33.345079 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a180390b-401e-4654-af8b-fdbcb96a3adc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095397 Jul 04 06:17:33.345647 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1040/2061] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:33 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:34.365990 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b74b16a-983d-4c09-ac9a-6de30e1e5d97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:34.366935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b74b16a-983d-4c09-ac9a-6de30e1e5d97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:34.375083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b74b16a-983d-4c09-ac9a-6de30e1e5d97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:34.375566 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b74b16a-983d-4c09-ac9a-6de30e1e5d97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:34.376342 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b74b16a-983d-4c09-ac9a-6de30e1e5d97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:34.376782 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b74b16a-983d-4c09-ac9a-6de30e1e5d97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:34.446634 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b74b16a-983d-4c09-ac9a-6de30e1e5d97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:34.455066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b74b16a-983d-4c09-ac9a-6de30e1e5d97 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095652 Jul 04 06:17:34.455661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1022/2062] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:34 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:35.475282 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6ea2213e-e13e-4a71-aa1e-ade077266289 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:35.476371 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6ea2213e-e13e-4a71-aa1e-ade077266289 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:35.484062 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ea2213e-e13e-4a71-aa1e-ade077266289 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:35.484514 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ea2213e-e13e-4a71-aa1e-ade077266289 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:35.485285 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ea2213e-e13e-4a71-aa1e-ade077266289 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:35.485724 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ea2213e-e13e-4a71-aa1e-ade077266289 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:35.548725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6ea2213e-e13e-4a71-aa1e-ade077266289 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:35.556944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6ea2213e-e13e-4a71-aa1e-ade077266289 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088395 Jul 04 06:17:35.557531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1041/2063] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:35 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:36.574765 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e96a72fd-e407-4fd5-b03e-e285a97a0b01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:36.575461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e96a72fd-e407-4fd5-b03e-e285a97a0b01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:36.582894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e96a72fd-e407-4fd5-b03e-e285a97a0b01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:36.583387 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e96a72fd-e407-4fd5-b03e-e285a97a0b01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:36.584189 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e96a72fd-e407-4fd5-b03e-e285a97a0b01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:36.584625 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e96a72fd-e407-4fd5-b03e-e285a97a0b01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:36.665173 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e96a72fd-e407-4fd5-b03e-e285a97a0b01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:36.677269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e96a72fd-e407-4fd5-b03e-e285a97a0b01 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.106898 Jul 04 06:17:36.678029 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1023/2064] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:36 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:37.006669 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:17:37.007004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:17:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:17:37.694588 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-81118632-1d46-4a5d-a645-956c85ec603a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:37.695209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-81118632-1d46-4a5d-a645-956c85ec603a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:37.702211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81118632-1d46-4a5d-a645-956c85ec603a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:37.702659 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81118632-1d46-4a5d-a645-956c85ec603a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:37.703467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81118632-1d46-4a5d-a645-956c85ec603a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:37.703955 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81118632-1d46-4a5d-a645-956c85ec603a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:37.768130 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-81118632-1d46-4a5d-a645-956c85ec603a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:37.776771 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-81118632-1d46-4a5d-a645-956c85ec603a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086129 Jul 04 06:17:37.777502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1042/2065] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:37 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:38.797821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0817400f-b5f1-43a8-b097-24236a543b04 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:38.798784 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0817400f-b5f1-43a8-b097-24236a543b04 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:38.809468 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0817400f-b5f1-43a8-b097-24236a543b04 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:38.809918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0817400f-b5f1-43a8-b097-24236a543b04 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:38.810693 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0817400f-b5f1-43a8-b097-24236a543b04 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:38.811131 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0817400f-b5f1-43a8-b097-24236a543b04 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:38.872035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0817400f-b5f1-43a8-b097-24236a543b04 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:38.880518 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0817400f-b5f1-43a8-b097-24236a543b04 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089490 Jul 04 06:17:38.881105 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1024/2066] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:38 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:39.902835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac26dcf1-3f26-4b67-8b44-2bf995ae7c69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:39.903532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ac26dcf1-3f26-4b67-8b44-2bf995ae7c69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:39.911166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac26dcf1-3f26-4b67-8b44-2bf995ae7c69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:39.911701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac26dcf1-3f26-4b67-8b44-2bf995ae7c69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:39.912549 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac26dcf1-3f26-4b67-8b44-2bf995ae7c69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:39.913036 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac26dcf1-3f26-4b67-8b44-2bf995ae7c69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:39.981156 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ac26dcf1-3f26-4b67-8b44-2bf995ae7c69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:39.994943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ac26dcf1-3f26-4b67-8b44-2bf995ae7c69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098956 Jul 04 06:17:39.995928 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1043/2067] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:39 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:41.019411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aed069af-1f20-4a36-b0a6-08e94b8a4dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:41.020144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aed069af-1f20-4a36-b0a6-08e94b8a4dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:41.022719 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=28 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:17:41.029935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aed069af-1f20-4a36-b0a6-08e94b8a4dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:41.030446 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aed069af-1f20-4a36-b0a6-08e94b8a4dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:41.031374 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aed069af-1f20-4a36-b0a6-08e94b8a4dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:41.031864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aed069af-1f20-4a36-b0a6-08e94b8a4dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:41.101805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aed069af-1f20-4a36-b0a6-08e94b8a4dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:41.110087 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aed069af-1f20-4a36-b0a6-08e94b8a4dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095335 Jul 04 06:17:41.110645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1025/2068] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:41 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:42.130836 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-84a21910-d496-4521-bed1-bc07ca0dd26c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:42.131936 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-84a21910-d496-4521-bed1-bc07ca0dd26c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:42.141980 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84a21910-d496-4521-bed1-bc07ca0dd26c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:42.142429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84a21910-d496-4521-bed1-bc07ca0dd26c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:42.143210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84a21910-d496-4521-bed1-bc07ca0dd26c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:42.143667 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84a21910-d496-4521-bed1-bc07ca0dd26c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:42.205513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-84a21910-d496-4521-bed1-bc07ca0dd26c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:42.214113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-84a21910-d496-4521-bed1-bc07ca0dd26c tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.089787 Jul 04 06:17:42.214693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1044/2069] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:42 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:43.231777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf08bc92-00e9-494d-92d3-04256b41b8c8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:43.232534 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bf08bc92-00e9-494d-92d3-04256b41b8c8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:43.241279 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf08bc92-00e9-494d-92d3-04256b41b8c8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:43.241840 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf08bc92-00e9-494d-92d3-04256b41b8c8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:43.242804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf08bc92-00e9-494d-92d3-04256b41b8c8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:43.243382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf08bc92-00e9-494d-92d3-04256b41b8c8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:43.306515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bf08bc92-00e9-494d-92d3-04256b41b8c8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:43.314595 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf08bc92-00e9-494d-92d3-04256b41b8c8 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087809 Jul 04 06:17:43.315048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1026/2070] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:43 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:44.335174 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a57e1902-f16a-4660-9073-6bf097c3876e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:44.336260 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a57e1902-f16a-4660-9073-6bf097c3876e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:44.339877 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=28 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:17:44.346763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a57e1902-f16a-4660-9073-6bf097c3876e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:44.347210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a57e1902-f16a-4660-9073-6bf097c3876e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:44.348000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a57e1902-f16a-4660-9073-6bf097c3876e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:44.348431 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a57e1902-f16a-4660-9073-6bf097c3876e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:44.413896 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a57e1902-f16a-4660-9073-6bf097c3876e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:44.423810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a57e1902-f16a-4660-9073-6bf097c3876e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095078 Jul 04 06:17:44.424377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1045/2071] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:44 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:45.441483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bba97563-48ec-470b-a140-92125ea269ab tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:45.442168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bba97563-48ec-470b-a140-92125ea269ab tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:45.450089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bba97563-48ec-470b-a140-92125ea269ab tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:45.450588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bba97563-48ec-470b-a140-92125ea269ab tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:45.451484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bba97563-48ec-470b-a140-92125ea269ab tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:45.451967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bba97563-48ec-470b-a140-92125ea269ab tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:45.517335 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bba97563-48ec-470b-a140-92125ea269ab tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:45.528084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bba97563-48ec-470b-a140-92125ea269ab tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090647 Jul 04 06:17:45.528834 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1027/2072] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:45 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:46.547003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d0ce8f71-aab4-4390-a3fd-7c0d1f9254cc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:46.547743 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d0ce8f71-aab4-4390-a3fd-7c0d1f9254cc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:46.554806 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0ce8f71-aab4-4390-a3fd-7c0d1f9254cc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:46.555275 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0ce8f71-aab4-4390-a3fd-7c0d1f9254cc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:46.556053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0ce8f71-aab4-4390-a3fd-7c0d1f9254cc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:46.556523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0ce8f71-aab4-4390-a3fd-7c0d1f9254cc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:46.625739 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d0ce8f71-aab4-4390-a3fd-7c0d1f9254cc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:46.634073 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d0ce8f71-aab4-4390-a3fd-7c0d1f9254cc tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090980 Jul 04 06:17:46.634657 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1046/2073] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:46 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:47.650835 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93ddc1f2-bea6-4422-bde3-c3b40eb84944 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:47.651428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-93ddc1f2-bea6-4422-bde3-c3b40eb84944 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:47.658214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93ddc1f2-bea6-4422-bde3-c3b40eb84944 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:47.658660 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93ddc1f2-bea6-4422-bde3-c3b40eb84944 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:47.659477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93ddc1f2-bea6-4422-bde3-c3b40eb84944 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:47.659907 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93ddc1f2-bea6-4422-bde3-c3b40eb84944 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:47.733124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-93ddc1f2-bea6-4422-bde3-c3b40eb84944 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:47.741429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-93ddc1f2-bea6-4422-bde3-c3b40eb84944 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095030 Jul 04 06:17:47.742002 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1028/2074] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:47 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:48.762283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a589a7b1-3594-40e8-8665-25cf52b1462a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:48.763298 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a589a7b1-3594-40e8-8665-25cf52b1462a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:48.774963 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a589a7b1-3594-40e8-8665-25cf52b1462a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:48.775663 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a589a7b1-3594-40e8-8665-25cf52b1462a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:48.776935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a589a7b1-3594-40e8-8665-25cf52b1462a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:48.777660 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a589a7b1-3594-40e8-8665-25cf52b1462a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:48.850256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a589a7b1-3594-40e8-8665-25cf52b1462a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:48.858961 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a589a7b1-3594-40e8-8665-25cf52b1462a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.103244 Jul 04 06:17:48.859578 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1047/2075] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:48 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:49.604806 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:17:49.605664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:17:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:17:49.878935 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5573f5b3-625d-469f-85c1-e769734c4bdf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:49.879510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5573f5b3-625d-469f-85c1-e769734c4bdf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:49.886680 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5573f5b3-625d-469f-85c1-e769734c4bdf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:49.887127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5573f5b3-625d-469f-85c1-e769734c4bdf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:49.887929 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5573f5b3-625d-469f-85c1-e769734c4bdf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:49.888363 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5573f5b3-625d-469f-85c1-e769734c4bdf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:49.952502 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5573f5b3-625d-469f-85c1-e769734c4bdf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:49.960594 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5573f5b3-625d-469f-85c1-e769734c4bdf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087860 Jul 04 06:17:49.961145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1029/2076] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:49 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:50.979520 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-891695f7-1000-4117-aa2b-b6fa5371829f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:50.980485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-891695f7-1000-4117-aa2b-b6fa5371829f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:50.990045 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-891695f7-1000-4117-aa2b-b6fa5371829f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:50.990498 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-891695f7-1000-4117-aa2b-b6fa5371829f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:50.991276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-891695f7-1000-4117-aa2b-b6fa5371829f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:50.991737 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-891695f7-1000-4117-aa2b-b6fa5371829f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:51.056501 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-891695f7-1000-4117-aa2b-b6fa5371829f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:51.065186 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-891695f7-1000-4117-aa2b-b6fa5371829f tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.091793 Jul 04 06:17:51.065761 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1048/2077] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:50 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:52.086261 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f7477e28-7c2c-4e86-8014-9ff3279fb72e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:52.086847 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f7477e28-7c2c-4e86-8014-9ff3279fb72e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:52.096813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f7477e28-7c2c-4e86-8014-9ff3279fb72e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:52.097459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f7477e28-7c2c-4e86-8014-9ff3279fb72e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:52.098315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f7477e28-7c2c-4e86-8014-9ff3279fb72e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:52.098746 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f7477e28-7c2c-4e86-8014-9ff3279fb72e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:52.163416 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f7477e28-7c2c-4e86-8014-9ff3279fb72e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:52.175241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f7477e28-7c2c-4e86-8014-9ff3279fb72e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.095373 Jul 04 06:17:52.176065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1030/2078] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:52 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:53.093024 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:17:53.093930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:17:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:17:53.198310 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-089e742b-513f-415e-a9fa-043e1395ac0b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:53.198911 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-089e742b-513f-415e-a9fa-043e1395ac0b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:53.206823 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-089e742b-513f-415e-a9fa-043e1395ac0b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:53.207630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-089e742b-513f-415e-a9fa-043e1395ac0b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:53.208841 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-089e742b-513f-415e-a9fa-043e1395ac0b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:53.209558 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-089e742b-513f-415e-a9fa-043e1395ac0b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:53.283701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-089e742b-513f-415e-a9fa-043e1395ac0b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:53.291961 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-089e742b-513f-415e-a9fa-043e1395ac0b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.097769 Jul 04 06:17:53.292515 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1049/2079] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:53 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:54.312987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f549bcd3-1071-4023-9986-807cbb5025e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:54.313968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f549bcd3-1071-4023-9986-807cbb5025e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:54.325284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f549bcd3-1071-4023-9986-807cbb5025e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:54.326034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f549bcd3-1071-4023-9986-807cbb5025e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:54.327313 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f549bcd3-1071-4023-9986-807cbb5025e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:54.328070 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f549bcd3-1071-4023-9986-807cbb5025e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:54.399748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f549bcd3-1071-4023-9986-807cbb5025e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:54.407840 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f549bcd3-1071-4023-9986-807cbb5025e9 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.101384 Jul 04 06:17:54.408396 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1031/2080] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:54 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:55.428727 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a470f41f-d588-4051-9039-cadb8655f900 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:55.429744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a470f41f-d588-4051-9039-cadb8655f900 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:55.440827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a470f41f-d588-4051-9039-cadb8655f900 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:55.441600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a470f41f-d588-4051-9039-cadb8655f900 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:55.442372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a470f41f-d588-4051-9039-cadb8655f900 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:55.442812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a470f41f-d588-4051-9039-cadb8655f900 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:55.511929 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a470f41f-d588-4051-9039-cadb8655f900 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:55.520750 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a470f41f-d588-4051-9039-cadb8655f900 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098627 Jul 04 06:17:55.521343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1050/2081] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:55 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:56.538198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-df105b72-9af3-449e-bd2c-b52675d6bc20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:56.538809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-df105b72-9af3-449e-bd2c-b52675d6bc20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:56.545794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df105b72-9af3-449e-bd2c-b52675d6bc20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:56.546241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df105b72-9af3-449e-bd2c-b52675d6bc20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:56.547004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df105b72-9af3-449e-bd2c-b52675d6bc20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:56.547481 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df105b72-9af3-449e-bd2c-b52675d6bc20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:56.610169 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df105b72-9af3-449e-bd2c-b52675d6bc20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:56.621833 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-df105b72-9af3-449e-bd2c-b52675d6bc20 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087331 Jul 04 06:17:56.622499 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1032/2082] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:56 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:57.639052 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-629fa563-81ad-4abd-b1bf-b8f1e1012191 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:57.639684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-629fa563-81ad-4abd-b1bf-b8f1e1012191 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:57.646323 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-629fa563-81ad-4abd-b1bf-b8f1e1012191 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:57.646771 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-629fa563-81ad-4abd-b1bf-b8f1e1012191 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:57.647573 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-629fa563-81ad-4abd-b1bf-b8f1e1012191 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:57.648008 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-629fa563-81ad-4abd-b1bf-b8f1e1012191 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:57.711697 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-629fa563-81ad-4abd-b1bf-b8f1e1012191 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:57.720166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-629fa563-81ad-4abd-b1bf-b8f1e1012191 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.085252 Jul 04 06:17:57.720713 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1051/2083] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:57 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:58.788965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b9a4140-a96e-4481-b007-54bacd793b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:58.789832 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b9a4140-a96e-4481-b007-54bacd793b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:58.800638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9a4140-a96e-4481-b007-54bacd793b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:58.801314 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9a4140-a96e-4481-b007-54bacd793b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:58.802102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9a4140-a96e-4481-b007-54bacd793b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:58.802527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9a4140-a96e-4481-b007-54bacd793b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:58.805332 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=84 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:17:58.866015 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b9a4140-a96e-4481-b007-54bacd793b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:17:58.878573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b9a4140-a96e-4481-b007-54bacd793b22 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096099 Jul 04 06:17:58.879435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1033/2084] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:58 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:17:59.902818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-57509523-ba0b-48e4-a394-958a611c510a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:17:59.903831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-57509523-ba0b-48e4-a394-958a611c510a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:17:59.913395 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57509523-ba0b-48e4-a394-958a611c510a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:59.913844 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57509523-ba0b-48e4-a394-958a611c510a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:59.918923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57509523-ba0b-48e4-a394-958a611c510a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:17:59.919428 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57509523-ba0b-48e4-a394-958a611c510a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:17:59.994918 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-57509523-ba0b-48e4-a394-958a611c510a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:00.007065 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-57509523-ba0b-48e4-a394-958a611c510a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.110883 Jul 04 06:18:00.007909 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1052/2085] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:17:59 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:01.033815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-264735a5-f278-40ae-9061-d457b171e49d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:01.034899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-264735a5-f278-40ae-9061-d457b171e49d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:01.042572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-264735a5-f278-40ae-9061-d457b171e49d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:01.042982 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-264735a5-f278-40ae-9061-d457b171e49d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:01.043832 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-264735a5-f278-40ae-9061-d457b171e49d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:01.044269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-264735a5-f278-40ae-9061-d457b171e49d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:01.105605 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-264735a5-f278-40ae-9061-d457b171e49d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:01.113744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-264735a5-f278-40ae-9061-d457b171e49d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.087340 Jul 04 06:18:01.114295 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1034/2086] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:01 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:02.131335 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e9f525bc-1d93-4437-b898-1781ad22c889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:02.131976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e9f525bc-1d93-4437-b898-1781ad22c889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:02.139192 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9f525bc-1d93-4437-b898-1781ad22c889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:02.139634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9f525bc-1d93-4437-b898-1781ad22c889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:02.140399 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9f525bc-1d93-4437-b898-1781ad22c889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:02.140839 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9f525bc-1d93-4437-b898-1781ad22c889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:02.229399 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e9f525bc-1d93-4437-b898-1781ad22c889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:02.237754 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e9f525bc-1d93-4437-b898-1781ad22c889 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.110377 Jul 04 06:18:02.238334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1053/2087] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:02 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:03.257962 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-228c3518-f61c-443d-ad0b-584f93619bfd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:03.258554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-228c3518-f61c-443d-ad0b-584f93619bfd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:03.265551 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-228c3518-f61c-443d-ad0b-584f93619bfd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:03.266003 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-228c3518-f61c-443d-ad0b-584f93619bfd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:03.266761 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-228c3518-f61c-443d-ad0b-584f93619bfd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:03.267198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-228c3518-f61c-443d-ad0b-584f93619bfd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:03.334434 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-228c3518-f61c-443d-ad0b-584f93619bfd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:03.342540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-228c3518-f61c-443d-ad0b-584f93619bfd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.090546 Jul 04 06:18:03.343103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1035/2088] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:03 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:04.363686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cb1e0f11-fbaf-4879-b3e5-b46eed7735ba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:04.364668 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cb1e0f11-fbaf-4879-b3e5-b46eed7735ba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:04.375112 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb1e0f11-fbaf-4879-b3e5-b46eed7735ba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:04.375914 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb1e0f11-fbaf-4879-b3e5-b46eed7735ba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:04.377152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb1e0f11-fbaf-4879-b3e5-b46eed7735ba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:04.377864 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb1e0f11-fbaf-4879-b3e5-b46eed7735ba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:04.383769 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=84 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:18:04.443360 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cb1e0f11-fbaf-4879-b3e5-b46eed7735ba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:04.451577 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cb1e0f11-fbaf-4879-b3e5-b46eed7735ba tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094565 Jul 04 06:18:04.452145 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1054/2089] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:04 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:05.472541 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-724d731a-8102-421f-adcd-d15cef71073a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:05.473496 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-724d731a-8102-421f-adcd-d15cef71073a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:05.485207 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-724d731a-8102-421f-adcd-d15cef71073a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:05.485951 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-724d731a-8102-421f-adcd-d15cef71073a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:05.487212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-724d731a-8102-421f-adcd-d15cef71073a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:05.487977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-724d731a-8102-421f-adcd-d15cef71073a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:05.559590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-724d731a-8102-421f-adcd-d15cef71073a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:05.568022 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-724d731a-8102-421f-adcd-d15cef71073a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.102129 Jul 04 06:18:05.568596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1036/2090] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:05 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:06.588820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42f1a431-4961-4518-89af-24f6d84dcdc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:06.589817 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-42f1a431-4961-4518-89af-24f6d84dcdc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:06.600822 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42f1a431-4961-4518-89af-24f6d84dcdc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:06.601563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42f1a431-4961-4518-89af-24f6d84dcdc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:06.602337 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42f1a431-4961-4518-89af-24f6d84dcdc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:06.602776 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42f1a431-4961-4518-89af-24f6d84dcdc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:06.673961 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-42f1a431-4961-4518-89af-24f6d84dcdc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:06.684131 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-42f1a431-4961-4518-89af-24f6d84dcdc2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.101980 Jul 04 06:18:06.684693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1055/2091] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:06 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:07.701102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe3ea64b-50a6-4d3d-90a8-3e4b19182c6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:07.701735 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe3ea64b-50a6-4d3d-90a8-3e4b19182c6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:07.708633 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe3ea64b-50a6-4d3d-90a8-3e4b19182c6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:07.709080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe3ea64b-50a6-4d3d-90a8-3e4b19182c6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:07.709842 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe3ea64b-50a6-4d3d-90a8-3e4b19182c6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:07.710310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe3ea64b-50a6-4d3d-90a8-3e4b19182c6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:07.774322 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe3ea64b-50a6-4d3d-90a8-3e4b19182c6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:07.785932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe3ea64b-50a6-4d3d-90a8-3e4b19182c6b tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088406 Jul 04 06:18:07.786648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1037/2092] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:07 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:08.807410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4ef48b67-799b-42af-b711-732789ca1496 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:08.808257 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4ef48b67-799b-42af-b711-732789ca1496 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:08.819215 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ef48b67-799b-42af-b711-732789ca1496 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:08.820129 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ef48b67-799b-42af-b711-732789ca1496 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:08.820893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ef48b67-799b-42af-b711-732789ca1496 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:08.821321 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ef48b67-799b-42af-b711-732789ca1496 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:08.894669 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4ef48b67-799b-42af-b711-732789ca1496 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:08.904511 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4ef48b67-799b-42af-b711-732789ca1496 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.103492 Jul 04 06:18:08.905079 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1056/2093] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:08 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:09.925949 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01dffb8c-9f00-4fd6-b70c-5b044987cf35 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:09.926843 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01dffb8c-9f00-4fd6-b70c-5b044987cf35 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:09.934646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01dffb8c-9f00-4fd6-b70c-5b044987cf35 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:09.935066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01dffb8c-9f00-4fd6-b70c-5b044987cf35 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:09.935874 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01dffb8c-9f00-4fd6-b70c-5b044987cf35 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:09.936301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01dffb8c-9f00-4fd6-b70c-5b044987cf35 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:09.997213 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01dffb8c-9f00-4fd6-b70c-5b044987cf35 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:10.005286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01dffb8c-9f00-4fd6-b70c-5b044987cf35 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086003 Jul 04 06:18:10.005841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1038/2094] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:09 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:11.026441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cee022ac-758a-45e6-af97-6a8ee79b81c6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:11.027532 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cee022ac-758a-45e6-af97-6a8ee79b81c6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:11.038629 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cee022ac-758a-45e6-af97-6a8ee79b81c6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:11.039053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cee022ac-758a-45e6-af97-6a8ee79b81c6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:11.039871 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cee022ac-758a-45e6-af97-6a8ee79b81c6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:11.040299 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cee022ac-758a-45e6-af97-6a8ee79b81c6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:11.103410 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cee022ac-758a-45e6-af97-6a8ee79b81c6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:11.111867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cee022ac-758a-45e6-af97-6a8ee79b81c6 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.092294 Jul 04 06:18:11.112456 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1057/2095] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:11 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:12.132678 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61c5cc1b-7787-4e7f-a4c3-d57dcdfc2107 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:12.133826 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61c5cc1b-7787-4e7f-a4c3-d57dcdfc2107 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:12.137405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=28 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:18:12.146314 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61c5cc1b-7787-4e7f-a4c3-d57dcdfc2107 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:12.147065 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61c5cc1b-7787-4e7f-a4c3-d57dcdfc2107 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:12.148602 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61c5cc1b-7787-4e7f-a4c3-d57dcdfc2107 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:12.149041 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61c5cc1b-7787-4e7f-a4c3-d57dcdfc2107 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:12.223721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61c5cc1b-7787-4e7f-a4c3-d57dcdfc2107 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:12.231992 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61c5cc1b-7787-4e7f-a4c3-d57dcdfc2107 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.105823 Jul 04 06:18:12.232553 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1039/2096] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:12 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:13.256487 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-26cbd6a4-75a0-4b13-a3a1-bdbf4e1c244a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:13.257430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-26cbd6a4-75a0-4b13-a3a1-bdbf4e1c244a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:13.266542 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26cbd6a4-75a0-4b13-a3a1-bdbf4e1c244a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:13.267007 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26cbd6a4-75a0-4b13-a3a1-bdbf4e1c244a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:13.267872 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26cbd6a4-75a0-4b13-a3a1-bdbf4e1c244a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:13.268327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26cbd6a4-75a0-4b13-a3a1-bdbf4e1c244a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:13.340378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-26cbd6a4-75a0-4b13-a3a1-bdbf4e1c244a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:13.348586 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-26cbd6a4-75a0-4b13-a3a1-bdbf4e1c244a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.098815 Jul 04 06:18:13.349163 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1058/2097] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:13 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:14.368320 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8d406593-9eb5-4bb0-bdf8-72538ed127ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:14.369082 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8d406593-9eb5-4bb0-bdf8-72538ed127ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:14.377540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d406593-9eb5-4bb0-bdf8-72538ed127ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:14.378106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d406593-9eb5-4bb0-bdf8-72538ed127ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:14.379066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d406593-9eb5-4bb0-bdf8-72538ed127ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:14.379648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d406593-9eb5-4bb0-bdf8-72538ed127ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:14.450336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d406593-9eb5-4bb0-bdf8-72538ed127ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:14.458561 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8d406593-9eb5-4bb0-bdf8-72538ed127ff tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096355 Jul 04 06:18:14.459130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1040/2098] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:14 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:15.478113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eed1a753-4cc7-418a-bf90-12db26430a2d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:15.478748 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eed1a753-4cc7-418a-bf90-12db26430a2d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:15.481071 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=28 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:18:15.486849 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eed1a753-4cc7-418a-bf90-12db26430a2d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:15.487386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eed1a753-4cc7-418a-bf90-12db26430a2d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:15.488170 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eed1a753-4cc7-418a-bf90-12db26430a2d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:15.488607 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eed1a753-4cc7-418a-bf90-12db26430a2d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:15.559477 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eed1a753-4cc7-418a-bf90-12db26430a2d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:15.567531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eed1a753-4cc7-418a-bf90-12db26430a2d tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.094769 Jul 04 06:18:15.568072 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1059/2099] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:15 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:16.585379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3378418e-14f3-4c39-9a47-95cdefd9d1f5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:16.585980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3378418e-14f3-4c39-9a47-95cdefd9d1f5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:16.593164 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3378418e-14f3-4c39-9a47-95cdefd9d1f5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:16.593676 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3378418e-14f3-4c39-9a47-95cdefd9d1f5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:16.594461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3378418e-14f3-4c39-9a47-95cdefd9d1f5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:16.594861 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3378418e-14f3-4c39-9a47-95cdefd9d1f5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:16.658972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3378418e-14f3-4c39-9a47-95cdefd9d1f5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:16.667469 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3378418e-14f3-4c39-9a47-95cdefd9d1f5 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.086071 Jul 04 06:18:16.668033 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1041/2100] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:16 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:17.684243 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-afdf8551-68c8-4b68-a32a-e3395cb52dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:17.684866 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-afdf8551-68c8-4b68-a32a-e3395cb52dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:17.691598 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-afdf8551-68c8-4b68-a32a-e3395cb52dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:17.692027 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-afdf8551-68c8-4b68-a32a-e3395cb52dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:17.692811 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-afdf8551-68c8-4b68-a32a-e3395cb52dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:17.693248 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-afdf8551-68c8-4b68-a32a-e3395cb52dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:17.755599 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-afdf8551-68c8-4b68-a32a-e3395cb52dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:17.764329 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-afdf8551-68c8-4b68-a32a-e3395cb52dae tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.084038 Jul 04 06:18:17.764922 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1060/2101] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:17 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:18.784105 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bcde6529-c054-47f9-b634-738dba7c63f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:18.784923 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bcde6529-c054-47f9-b634-738dba7c63f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:18.795697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcde6529-c054-47f9-b634-738dba7c63f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:18.796430 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcde6529-c054-47f9-b634-738dba7c63f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:18.797673 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcde6529-c054-47f9-b634-738dba7c63f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:18.798293 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcde6529-c054-47f9-b634-738dba7c63f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:18.863886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bcde6529-c054-47f9-b634-738dba7c63f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:18.872238 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bcde6529-c054-47f9-b634-738dba7c63f1 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.093819 Jul 04 06:18:18.872795 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1042/2102] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:18 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:19.893760 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b761cdb9-150e-49b3-8b8a-62e7330d91ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:19.894694 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b761cdb9-150e-49b3-8b8a-62e7330d91ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:19.906164 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b761cdb9-150e-49b3-8b8a-62e7330d91ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:19.906925 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b761cdb9-150e-49b3-8b8a-62e7330d91ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:19.908350 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b761cdb9-150e-49b3-8b8a-62e7330d91ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:19.909078 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b761cdb9-150e-49b3-8b8a-62e7330d91ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:19.974394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b761cdb9-150e-49b3-8b8a-62e7330d91ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:19.983011 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b761cdb9-150e-49b3-8b8a-62e7330d91ec tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.096207 Jul 04 06:18:19.983638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1061/2103] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:19 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:21.005757 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-70f62eea-5556-4121-aa9d-33b6805cfbbf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:21.006500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-70f62eea-5556-4121-aa9d-33b6805cfbbf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: 6141b5a5-5e40-4d2e-afb1-ff85c45f0620] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:21.014503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f62eea-5556-4121-aa9d-33b6805cfbbf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:21.015030 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f62eea-5556-4121-aa9d-33b6805cfbbf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:21.015956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f62eea-5556-4121-aa9d-33b6805cfbbf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:21.016468 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f62eea-5556-4121-aa9d-33b6805cfbbf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:21.081515 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-70f62eea-5556-4121-aa9d-33b6805cfbbf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:18:21.089422 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-70f62eea-5556-4121-aa9d-33b6805cfbbf tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620" status: 200 len: 1377 microversion: 2.1 time: 0.088241 Jul 04 06:18:21.090031 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1043/2104] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:20 2022] GET /compute/v2.1/servers/6141b5a5-5e40-4d2e-afb1-ff85c45f0620 => generated 1377 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:18:21.105020 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a858a824-c541-40f3-83ba-4b08a854149e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '.version_select at 0x7f204fd6dc10>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:21.130089 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a858a824-c541-40f3-83ba-4b08a854149e tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812064032" status: 202 len: 0 microversion: 2.1 time: 0.028831 Jul 04 06:18:21.130655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1062/2105] 10.222.0.42 () {58 vars in 1220 bytes} [Mon Jul 4 06:18:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812064032 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:18:23.479349 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a8c6caa2-ffac-494f-948e-54cbafff1042 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:23.480001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a8c6caa2-ffac-494f-948e-54cbafff1042 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:23.486524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c6caa2-ffac-494f-948e-54cbafff1042 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:23.486961 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c6caa2-ffac-494f-948e-54cbafff1042 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:23.487794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c6caa2-ffac-494f-948e-54cbafff1042 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:23.488221 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c6caa2-ffac-494f-948e-54cbafff1042 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-a8c6caa2-ffac-494f-948e-54cbafff1042 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a8c6caa2-ffac-494f-948e-54cbafff1042 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 HTTP/1.1 Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:18:23.515804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:18:23.517846 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '5e6fb72d-5a19-43fb-9fa5-b630aa555080'} Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:18:23.518900 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:18:23.520428 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.521901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a8c6caa2-ffac-494f-948e-54cbafff1042 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:18:23.521901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a8c6caa2-ffac-494f-948e-54cbafff1042 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 404 len: 111 microversion: 2.1 time: 0.040055 Jul 04 06:18:23.521901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1044/2106] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:18:23 2022] DELETE /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:18:23.524088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f3bbbb9e-e2f0-4bb0-9bb5-0dd30de01dda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:23.524841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f3bbbb9e-e2f0-4bb0-9bb5-0dd30de01dda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 5e6fb72d-5a19-43fb-9fa5-b630aa555080] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:23.529481 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c14299b8-b255-44ad-9f54-5616ef043bb5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:23.530079 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c14299b8-b255-44ad-9f54-5616ef043bb5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:23.532222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3bbbb9e-e2f0-4bb0-9bb5-0dd30de01dda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:23.532661 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3bbbb9e-e2f0-4bb0-9bb5-0dd30de01dda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:23.533641 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3bbbb9e-e2f0-4bb0-9bb5-0dd30de01dda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:23.534124 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3bbbb9e-e2f0-4bb0-9bb5-0dd30de01dda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:23.537405 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c14299b8-b255-44ad-9f54-5616ef043bb5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:23.537914 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c14299b8-b255-44ad-9f54-5616ef043bb5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:23.538869 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c14299b8-b255-44ad-9f54-5616ef043bb5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:23.539417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c14299b8-b255-44ad-9f54-5616ef043bb5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:23.549315 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-f3bbbb9e-e2f0-4bb0-9bb5-0dd30de01dda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f3bbbb9e-e2f0-4bb0-9bb5-0dd30de01dda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 HTTP/1.1 Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:18:23.551095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:18:23.552682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '5e6fb72d-5a19-43fb-9fa5-b630aa555080'} Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:18:23.553538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. Jul 04 06:18:23.554948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.556954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f3bbbb9e-e2f0-4bb0-9bb5-0dd30de01dda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 5e6fb72d-5a19-43fb-9fa5-b630aa555080 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:18:23.556954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f3bbbb9e-e2f0-4bb0-9bb5-0dd30de01dda tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080" status: 404 len: 111 microversion: 2.1 time: 0.032535 Jul 04 06:18:23.556954 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1045/2107] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:18:23 2022] GET /compute/v2.1/servers/5e6fb72d-5a19-43fb-9fa5-b630aa555080 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:18:23.557385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-c14299b8-b255-44ad-9f54-5616ef043bb5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] HTTP exception thrown: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c14299b8-b255-44ad-9f54-5616ef043bb5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Request method failure captured: Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 HTTP/1.1 Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoB8bKsJbNvGOnJjkpXV9bswTHj3lvwmYf__bTpxb2VlLNE2omAzkDjdRLHE1uFhHtcDQ1zYoQVE7lUvW_r_RK0AyDeSWrYbMF_qOnsoDGhYORcDduFofYuPv_uj9uZoyMIkGuP-AxfvlL4ICDPHroDYuGc-vuMdyYkjQJ4MJ96ufkc Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 06:18:23.558935 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 982651a870c44a07bc4df322919e605e Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 06:18:23.562034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '178121f0-a865-467e-a46a-069b621b6d17'} Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:18:23.563043 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 06:18:23.565313 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.567150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c14299b8-b255-44ad-9f54-5616ef043bb5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Returning 404 to user: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:18:23.567150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c14299b8-b255-44ad-9f54-5616ef043bb5 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "DELETE /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 404 len: 111 microversion: 2.20 time: 0.048076 Jul 04 06:18:23.567150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1063/2108] 10.222.0.42 () {60 vars in 1279 bytes} [Mon Jul 4 06:18:23 2022] DELETE /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 04 06:18:23.569339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c4e1621-79ef-4234-9e57-8cb21b842ef1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:18:23.570067 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9c4e1621-79ef-4234-9e57-8cb21b842ef1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] [instance: 178121f0-a865-467e-a46a-069b621b6d17] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:18:23.576244 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c4e1621-79ef-4234-9e57-8cb21b842ef1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:23.576685 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c4e1621-79ef-4234-9e57-8cb21b842ef1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:23.577432 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c4e1621-79ef-4234-9e57-8cb21b842ef1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:18:23.577914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c4e1621-79ef-4234-9e57-8cb21b842ef1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:18:23.591286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-9c4e1621-79ef-4234-9e57-8cb21b842ef1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] HTTP exception thrown: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c4e1621-79ef-4234-9e57-8cb21b842ef1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Request method failure captured: Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 HTTP/1.1 Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoB8bKsJbNvGOnJjkpXV9bswTHj3lvwmYf__bTpxb2VlLNE2omAzkDjdRLHE1uFhHtcDQ1zYoQVE7lUvW_r_RK0AyDeSWrYbMF_qOnsoDGhYORcDduFofYuPv_uj9uZoyMIkGuP-AxfvlL4ICDPHroDYuGc-vuMdyYkjQJ4MJ96ufkc Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:18:23.592777 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3251b70a6c64287acc95cc99d4e3b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: f3251b70a6c64287acc95cc99d4e3b4d Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-170696652 Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 982651a870c44a07bc4df322919e605e Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-170696652-project Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 06:18:23.594706 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '178121f0-a865-467e-a46a-069b621b6d17'} Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:18:23.595759 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. Jul 04 06:18:23.597500 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:18:23.599269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c4e1621-79ef-4234-9e57-8cb21b842ef1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] Returning 404 to user: Instance 178121f0-a865-467e-a46a-069b621b6d17 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:18:23.599269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9c4e1621-79ef-4234-9e57-8cb21b842ef1 tempest-AttachVolumeShelveTestJSON-170696652 tempest-AttachVolumeShelveTestJSON-170696652-project] 10.222.0.42 "GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17" status: 404 len: 111 microversion: 2.20 time: 0.029074 Jul 04 06:18:23.599269 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1046/2109] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jul 4 06:18:23 2022] GET /compute/v2.1/servers/178121f0-a865-467e-a46a-069b621b6d17 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 06:19:11.854643 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:19:11.855570 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:19:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:20:24.242026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:20:24.242754 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=49 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:20:24.246790 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e9d7bd3-2d1d-4009-b606-2ecba4d80e75 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:20:24.247201 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e9d7bd3-2d1d-4009-b606-2ecba4d80e75 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:20:24.254565 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e9d7bd3-2d1d-4009-b606-2ecba4d80e75 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:20:24.255082 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e9d7bd3-2d1d-4009-b606-2ecba4d80e75 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:20:24.255975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e9d7bd3-2d1d-4009-b606-2ecba4d80e75 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:20:24.257400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e9d7bd3-2d1d-4009-b606-2ecba4d80e75 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:20:24.271831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-4e9d7bd3-2d1d-4009-b606-2ecba4d80e75 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] HTTP exception thrown: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e9d7bd3-2d1d-4009-b606-2ecba4d80e75 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Request method failure captured: Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a HTTP/1.1 Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoCEUy_tkDjUbVKcexapYDAsm40eALAF_dR72XCRiPOAjjY_kvltuR8PCLFjH0f4aNu7xrSw_7JDtTHQcBWxoA1U4NVcaSanOU_o948upgIv2ysLLAABEBrFpimbso2wYYcX-Syirc3zdf6h3irlfBmfus4yp-93Cx-MzRohzZ4xanY Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 06:20:24.273725 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 32703b5451cf48b09966a7412b747099 Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:20:24.275502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '9979d81a-1d93-423a-b99e-74434186140a'} Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:20:24.276379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:20:24.277901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:20:24.279602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e9d7bd3-2d1d-4009-b606-2ecba4d80e75 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Returning 404 to user: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:20:24.279602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e9d7bd3-2d1d-4009-b606-2ecba4d80e75 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 404 len: 111 microversion: 2.1 time: 0.034941 Jul 04 06:20:24.279602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1064/2110] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:20:24 2022] DELETE /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:20:24.281663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=15 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:20:24.282402 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=71 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:20:24.286487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4cbc3f24-2e46-40fc-840a-976024d0e608 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:20:24.287009 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4cbc3f24-2e46-40fc-840a-976024d0e608 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] [instance: 9979d81a-1d93-423a-b99e-74434186140a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:20:24.294034 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cbc3f24-2e46-40fc-840a-976024d0e608 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:20:24.294489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cbc3f24-2e46-40fc-840a-976024d0e608 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:20:24.295273 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cbc3f24-2e46-40fc-840a-976024d0e608 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:20:24.295715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cbc3f24-2e46-40fc-840a-976024d0e608 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:20:24.309505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-4cbc3f24-2e46-40fc-840a-976024d0e608 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] HTTP exception thrown: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4cbc3f24-2e46-40fc-840a-976024d0e608 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Request method failure captured: Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a HTTP/1.1 Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoCEUy_tkDjUbVKcexapYDAsm40eALAF_dR72XCRiPOAjjY_kvltuR8PCLFjH0f4aNu7xrSw_7JDtTHQcBWxoA1U4NVcaSanOU_o948upgIv2ysLLAABEBrFpimbso2wYYcX-Syirc3zdf6h3irlfBmfus4yp-93Cx-MzRohzZ4xanY Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:20:24.311036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdd96113d4ef451d9ffc81c03c6ea70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: bdd96113d4ef451d9ffc81c03c6ea70e Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1839563419 Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 32703b5451cf48b09966a7412b747099 Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeTestJSON-1839563419-project Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:20:24.312971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '9979d81a-1d93-423a-b99e-74434186140a'} Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:20:24.313841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. Jul 04 06:20:24.315268 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:20:24.316516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4cbc3f24-2e46-40fc-840a-976024d0e608 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] Returning 404 to user: Instance 9979d81a-1d93-423a-b99e-74434186140a could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:20:24.316516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4cbc3f24-2e46-40fc-840a-976024d0e608 tempest-AttachVolumeTestJSON-1839563419 tempest-AttachVolumeTestJSON-1839563419-project] 10.222.0.42 "GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a" status: 404 len: 111 microversion: 2.1 time: 0.032581 Jul 04 06:20:24.316516 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1047/2111] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:20:24 2022] GET /compute/v2.1/servers/9979d81a-1d93-423a-b99e-74434186140a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:20:45.764114 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:20:45.765439 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:20:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:20:54.237820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 04 06:20:54.238798 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:20:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:20:57.019878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:20:57.020713 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:20:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:21:09.616558 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:21:09.617488 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:21:13.104602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:21:13.105348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:21:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:21:23.576654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c275389b-a71d-4d09-9367-a2e4fce5ff41] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 04 06:21:23.577368 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:21:23.578181 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:21:23.758556 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-6397c029-2461-4a73-92df-98fc61019d8b req-edaa4f2d-4193-4f36-938c-47414f869aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9120ac5f-6d50-4583-adae-9bc3766e686f", "name": "network-vif-deleted", "tag": "3a2af85f-c3ee-4fa8-9b23-ba37662e58b6"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:21:23.762784 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6397c029-2461-4a73-92df-98fc61019d8b req-edaa4f2d-4193-4f36-938c-47414f869aa4 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:21:23.763225 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6397c029-2461-4a73-92df-98fc61019d8b req-edaa4f2d-4193-4f36-938c-47414f869aa4 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:21:23.774326 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-6397c029-2461-4a73-92df-98fc61019d8b req-edaa4f2d-4193-4f36-938c-47414f869aa4 service nova] Creating event network-vif-deleted:3a2af85f-c3ee-4fa8-9b23-ba37662e58b6 for instance 9120ac5f-6d50-4583-adae-9bc3766e686f on hv-cinder-79733 Jul 04 06:21:23.780943 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-6397c029-2461-4a73-92df-98fc61019d8b req-edaa4f2d-4193-4f36-938c-47414f869aa4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209338 Jul 04 06:21:23.781654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1065/2112] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:22:31.868781 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:22:31.869575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:22:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:24:05.776479 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:24:05.777165 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:24:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:24:14.248611 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:24:14.249537 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:24:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:24:17.033921 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:24:17.034739 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:24:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:24:29.629967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:24:29.630967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:24:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:24:33.116912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:24:33.117709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:24:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:25:22.190708 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9532a89-354a-4905-bb83-9d0bf8d62961] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 04 06:25:22.191404 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:25:22.192339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:25:22.196487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-41932dad-456f-4a35-8376-58675d015c39 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:25:22.196993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-41932dad-456f-4a35-8376-58675d015c39 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:25:22.203950 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41932dad-456f-4a35-8376-58675d015c39 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:25:22.204397 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41932dad-456f-4a35-8376-58675d015c39 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:25:22.205156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41932dad-456f-4a35-8376-58675d015c39 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:25:22.205588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41932dad-456f-4a35-8376-58675d015c39 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:25:22.218793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-41932dad-456f-4a35-8376-58675d015c39 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-41932dad-456f-4a35-8376-58675d015c39 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 HTTP/1.1 Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:25:22.220367 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:25:22.222301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '9ad9b47c-9ec3-4208-baf7-6743e129f162'} Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:25:22.223436 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:25:22.225559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.227429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-41932dad-456f-4a35-8376-58675d015c39 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:25:22.227429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-41932dad-456f-4a35-8376-58675d015c39 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 404 len: 111 microversion: 2.1 time: 0.033832 Jul 04 06:25:22.227429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1048/2113] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:25:22 2022] DELETE /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:25:22.228923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:25:22.229689 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:25:22.234441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-381bbe0d-cc11-4ba5-9695-521a336f27a2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:25:22.235141 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-381bbe0d-cc11-4ba5-9695-521a336f27a2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 9ad9b47c-9ec3-4208-baf7-6743e129f162] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:25:22.244715 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381bbe0d-cc11-4ba5-9695-521a336f27a2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:25:22.245162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381bbe0d-cc11-4ba5-9695-521a336f27a2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:25:22.245955 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381bbe0d-cc11-4ba5-9695-521a336f27a2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:25:22.246386 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-381bbe0d-cc11-4ba5-9695-521a336f27a2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:25:22.247003 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] [c275389b-a71d-4d09-9367-a2e4fce5ff41] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 33844. Jul 04 06:25:22.261770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-381bbe0d-cc11-4ba5-9695-521a336f27a2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-381bbe0d-cc11-4ba5-9695-521a336f27a2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 HTTP/1.1 Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 06:25:22.263430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:25:22.265083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '9ad9b47c-9ec3-4208-baf7-6743e129f162'} Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:25:22.265924 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. Jul 04 06:25:22.267385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.268640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-381bbe0d-cc11-4ba5-9695-521a336f27a2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 9ad9b47c-9ec3-4208-baf7-6743e129f162 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:25:22.268640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-381bbe0d-cc11-4ba5-9695-521a336f27a2 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162" status: 404 len: 111 microversion: 2.1 time: 0.037974 Jul 04 06:25:22.268640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1066/2114] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:25:22 2022] GET /compute/v2.1/servers/9ad9b47c-9ec3-4208-baf7-6743e129f162 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:25:22.273831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ebbddc2-53f9-4469-9950-9561a2b05924 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:25:22.274358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3ebbddc2-53f9-4469-9950-9561a2b05924 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:25:22.281004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ebbddc2-53f9-4469-9950-9561a2b05924 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:25:22.281460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ebbddc2-53f9-4469-9950-9561a2b05924 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:25:22.282221 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ebbddc2-53f9-4469-9950-9561a2b05924 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:25:22.282728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ebbddc2-53f9-4469-9950-9561a2b05924 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:25:22.305969 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-3ebbddc2-53f9-4469-9950-9561a2b05924 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ebbddc2-53f9-4469-9950-9561a2b05924 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b HTTP/1.1 Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:25:22.307622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 06:25:22.309484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '6e5a689e-ec6d-40f5-beeb-36326b13fb0b'} Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:25:22.311035 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 06:25:22.313871 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.315788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ebbddc2-53f9-4469-9950-9561a2b05924 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:25:22.315788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3ebbddc2-53f9-4469-9950-9561a2b05924 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 404 len: 111 microversion: 2.1 time: 0.039217 Jul 04 06:25:22.315788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1049/2115] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:25:22 2022] DELETE /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:25:22.319647 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-97ac91c0-252f-44de-a234-7ac6dde7f47b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:25:22.320263 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-97ac91c0-252f-44de-a234-7ac6dde7f47b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 6e5a689e-ec6d-40f5-beeb-36326b13fb0b] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:25:22.326440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97ac91c0-252f-44de-a234-7ac6dde7f47b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:25:22.327278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97ac91c0-252f-44de-a234-7ac6dde7f47b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:25:22.328060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97ac91c0-252f-44de-a234-7ac6dde7f47b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:25:22.328489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97ac91c0-252f-44de-a234-7ac6dde7f47b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:25:22.342192 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-97ac91c0-252f-44de-a234-7ac6dde7f47b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-97ac91c0-252f-44de-a234-7ac6dde7f47b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b HTTP/1.1 Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 06:25:22.343762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 06:25:22.345655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '6e5a689e-ec6d-40f5-beeb-36326b13fb0b'} Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:25:22.346640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. Jul 04 06:25:22.348346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:25:22.350068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-97ac91c0-252f-44de-a234-7ac6dde7f47b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 6e5a689e-ec6d-40f5-beeb-36326b13fb0b could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:25:22.350068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-97ac91c0-252f-44de-a234-7ac6dde7f47b tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b" status: 404 len: 111 microversion: 2.1 time: 0.029374 Jul 04 06:25:22.350068 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1067/2116] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:25:22 2022] GET /compute/v2.1/servers/6e5a689e-ec6d-40f5-beeb-36326b13fb0b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 06:25:51.878459 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:25:51.879523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:25:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:27:25.786313 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:27:25.787163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:27:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:27:34.262050 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:27:34.262885 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:27:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:27:37.047487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:27:37.048241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:27:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:27:49.639932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:27:49.640489 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:27:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:27:53.130195 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:27:53.130684 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:27:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:29:11.891996 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:29:11.892756 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:29:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:29:21.256575 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:29:21.257692 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:29:21.262493 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0912256a-4e6e-4fb0-8eba-50e6f394c9c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:21.262986 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0912256a-4e6e-4fb0-8eba-50e6f394c9c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:21.272630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0912256a-4e6e-4fb0-8eba-50e6f394c9c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:21.273083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0912256a-4e6e-4fb0-8eba-50e6f394c9c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:21.273845 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0912256a-4e6e-4fb0-8eba-50e6f394c9c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:21.274264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0912256a-4e6e-4fb0-8eba-50e6f394c9c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:21.298841 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9532a89-354a-4905-bb83-9d0bf8d62961] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 35752. Jul 04 06:29:21.316085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0912256a-4e6e-4fb0-8eba-50e6f394c9c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:29:21.389283 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0912256a-4e6e-4fb0-8eba-50e6f394c9c7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 204 len: 0 microversion: 2.1 time: 0.134515 Jul 04 06:29:21.390005 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1050/2117] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:29:21 2022] DELETE /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 06:29:21.395869 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c275389b-a71d-4d09-9367-a2e4fce5ff41] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 04 06:29:21.400590 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9bd09f07-b160-4a2f-ace5-9a7edbfee2cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:21.402682 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9bd09f07-b160-4a2f-ace5-9a7edbfee2cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:21.404712 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:29:21.405344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:29:21.411672 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bd09f07-b160-4a2f-ace5-9a7edbfee2cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:21.412734 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bd09f07-b160-4a2f-ace5-9a7edbfee2cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:21.413548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bd09f07-b160-4a2f-ace5-9a7edbfee2cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:21.413993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bd09f07-b160-4a2f-ace5-9a7edbfee2cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:21.688990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9bd09f07-b160-4a2f-ace5-9a7edbfee2cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:21.697103 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9bd09f07-b160-4a2f-ace5-9a7edbfee2cd tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1507 microversion: 2.1 time: 0.303351 Jul 04 06:29:21.697876 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1068/2118] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:21 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:29:21.717396 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3b040f65-0c0c-4429-bf19-f9cac8432b70 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:21.717973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3b040f65-0c0c-4429-bf19-f9cac8432b70 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:21.724233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b040f65-0c0c-4429-bf19-f9cac8432b70 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:21.724672 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b040f65-0c0c-4429-bf19-f9cac8432b70 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:21.725447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b040f65-0c0c-4429-bf19-f9cac8432b70 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:21.725873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b040f65-0c0c-4429-bf19-f9cac8432b70 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:21.740475 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-3b040f65-0c0c-4429-bf19-f9cac8432b70 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3b040f65-0c0c-4429-bf19-f9cac8432b70 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 HTTP/1.1 Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:29:21.742151 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 06:29:21.743505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': '91a604de-7fc4-4f6c-9fce-acd174439f47'} Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:29:21.744106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 06:29:21.745075 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:29:21.747523 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3b040f65-0c0c-4429-bf19-f9cac8432b70 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:29:21.748533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3b040f65-0c0c-4429-bf19-f9cac8432b70 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "DELETE /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 404 len: 111 microversion: 2.1 time: 0.035651 Jul 04 06:29:21.749095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1051/2119] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:29:21 2022] DELETE /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:29:21.758014 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eb761839-3c98-431d-80e0-c5c54a65d2d9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:21.758687 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eb761839-3c98-431d-80e0-c5c54a65d2d9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] [instance: 91a604de-7fc4-4f6c-9fce-acd174439f47] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:21.765736 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb761839-3c98-431d-80e0-c5c54a65d2d9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:21.766189 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb761839-3c98-431d-80e0-c5c54a65d2d9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:21.766955 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb761839-3c98-431d-80e0-c5c54a65d2d9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:21.767569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb761839-3c98-431d-80e0-c5c54a65d2d9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:21.783533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-eb761839-3c98-431d-80e0-c5c54a65d2d9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] HTTP exception thrown: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eb761839-3c98-431d-80e0-c5c54a65d2d9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Request method failure captured: Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 HTTP/1.1 Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoCFbSddMyEb8DgjDHDSH-_IRnndsOGh5EG5YurvZjfIhS1-n1WVgyLOnuSwy1q3i1mbBIzjFCXOQPVnND9BDzhLjwe3XegcYRU47gK2EIEuGSW6sZM5odjjVWxh6EmxK6cgBm6OBRK0Bnf1qGEXFFFIzf73uLPusX-nzJnBa6IvoBM Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 06:29:21.785053 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e16375231df4b768b8355e320e91731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e16375231df4b768b8355e320e91731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e16375231df4b768b8355e320e91731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 4e16375231df4b768b8355e320e91731 Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-419940014 Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: e367c76dfa7f4d2791e60ce148f352c3 Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-419940014-project Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 06:29:21.786289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': '91a604de-7fc4-4f6c-9fce-acd174439f47'} Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:29:21.786912 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. Jul 04 06:29:21.787970 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:29:21.788816 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eb761839-3c98-431d-80e0-c5c54a65d2d9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] Returning 404 to user: Instance 91a604de-7fc4-4f6c-9fce-acd174439f47 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:29:21.788816 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eb761839-3c98-431d-80e0-c5c54a65d2d9 tempest-AttachVolumeNegativeTest-419940014 tempest-AttachVolumeNegativeTest-419940014-project] 10.222.0.42 "GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47" status: 404 len: 111 microversion: 2.1 time: 0.032789 Jul 04 06:29:21.788816 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1069/2120] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:21 2022] GET /compute/v2.1/servers/91a604de-7fc4-4f6c-9fce-acd174439f47 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:29:22.714821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6d1ac4ab-7671-43a1-bb97-f6ee3998aac2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:22.715613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6d1ac4ab-7671-43a1-bb97-f6ee3998aac2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:22.722063 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d1ac4ab-7671-43a1-bb97-f6ee3998aac2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:22.722716 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d1ac4ab-7671-43a1-bb97-f6ee3998aac2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:22.723872 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d1ac4ab-7671-43a1-bb97-f6ee3998aac2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:22.724459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d1ac4ab-7671-43a1-bb97-f6ee3998aac2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:22.926186 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6d1ac4ab-7671-43a1-bb97-f6ee3998aac2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:22.934017 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6d1ac4ab-7671-43a1-bb97-f6ee3998aac2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1507 microversion: 2.1 time: 0.223739 Jul 04 06:29:22.934891 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1052/2121] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:22 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:29:23.950500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b74d7963-48f6-474a-9143-321748d26f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:23.951108 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b74d7963-48f6-474a-9143-321748d26f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:23.963765 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] [c275389b-a71d-4d09-9367-a2e4fce5ff41] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 35802. Jul 04 06:29:23.968517 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b74d7963-48f6-474a-9143-321748d26f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:23.968976 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b74d7963-48f6-474a-9143-321748d26f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:23.969768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b74d7963-48f6-474a-9143-321748d26f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:23.970208 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b74d7963-48f6-474a-9143-321748d26f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:24.338923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b74d7963-48f6-474a-9143-321748d26f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:24.346707 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b74d7963-48f6-474a-9143-321748d26f69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1507 microversion: 2.1 time: 0.400331 Jul 04 06:29:24.347292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1070/2122] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:23 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:29:25.322158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-76e04910-e41e-4991-804e-4df446b11b11 req-870ce97f-58c7-40a6-8a9b-4fa0e95b18a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71ad769-1afe-49ae-83d5-07e64f9e4f0c", "name": "network-vif-deleted", "tag": "0766d56f-8c07-4df0-b7aa-543c32d5eb3a"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:29:25.333600 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-76e04910-e41e-4991-804e-4df446b11b11 req-870ce97f-58c7-40a6-8a9b-4fa0e95b18a0 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:25.333952 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-76e04910-e41e-4991-804e-4df446b11b11 req-870ce97f-58c7-40a6-8a9b-4fa0e95b18a0 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:25.353967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-76e04910-e41e-4991-804e-4df446b11b11 req-870ce97f-58c7-40a6-8a9b-4fa0e95b18a0 service nova] Creating event network-vif-deleted:0766d56f-8c07-4df0-b7aa-543c32d5eb3a for instance b71ad769-1afe-49ae-83d5-07e64f9e4f0c on hv-cinder-79733 Jul 04 06:29:25.373334 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5f43d94a-19f5-4e57-9d67-a172d434ecc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:25.374137 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5f43d94a-19f5-4e57-9d67-a172d434ecc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:25.392278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f43d94a-19f5-4e57-9d67-a172d434ecc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:25.392540 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f43d94a-19f5-4e57-9d67-a172d434ecc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:25.393648 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-76e04910-e41e-4991-804e-4df446b11b11 req-870ce97f-58c7-40a6-8a9b-4fa0e95b18a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300135 Jul 04 06:29:25.394272 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1053/2123] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:29:25.397223 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f43d94a-19f5-4e57-9d67-a172d434ecc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:25.397954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f43d94a-19f5-4e57-9d67-a172d434ecc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:25.453422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f43d94a-19f5-4e57-9d67-a172d434ecc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:25.453837 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f43d94a-19f5-4e57-9d67-a172d434ecc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:25.454294 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-5f43d94a-19f5-4e57-9d67-a172d434ecc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lazy-loading 'fault' on Instance uuid b71ad769-1afe-49ae-83d5-07e64f9e4f0c {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:29:25.523115 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5f43d94a-19f5-4e57-9d67-a172d434ecc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:25.540418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5f43d94a-19f5-4e57-9d67-a172d434ecc7 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 200 len: 1312 microversion: 2.1 time: 0.180262 Jul 04 06:29:25.550744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1071/2124] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:25 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 1312 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 06:29:26.563135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-573f6c2c-30cd-45dd-b8d0-dc5072a0226a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:26.563135 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-573f6c2c-30cd-45dd-b8d0-dc5072a0226a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b71ad769-1afe-49ae-83d5-07e64f9e4f0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:26.570036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-573f6c2c-30cd-45dd-b8d0-dc5072a0226a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:26.570477 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-573f6c2c-30cd-45dd-b8d0-dc5072a0226a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:26.571852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-573f6c2c-30cd-45dd-b8d0-dc5072a0226a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:26.572304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-573f6c2c-30cd-45dd-b8d0-dc5072a0226a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:26.587859 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-573f6c2c-30cd-45dd-b8d0-dc5072a0226a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] HTTP exception thrown: Instance b71ad769-1afe-49ae-83d5-07e64f9e4f0c could not be found. Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-573f6c2c-30cd-45dd-b8d0-dc5072a0226a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Request method failure captured: Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c HTTP/1.1 Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwoDWduuQd-4LtLNBEsfndOQNnXdCxbhhefkVWxp7Albf8nz6dEzS5A6jt7Yk4-6ho1E-i8y4BxVlVPtK6kmSp7NVCcP2VYorrWW6H95pQXHmX2qA8R11XcUz1Tm7EZIHyhBTnPj1d2JHdR1z7jukPed2TtJYhxuENM3DtP7zltIxXrg Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 27aa4fc6d2bd46d3a3492cf0b1d7ae9d Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:29:26.589667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 27aa4fc6d2bd46d3a3492cf0b1d7ae9d Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-1901791098-project Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 93ae888c6e364e2e96ff52e63415a0e5 Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1901791098-project Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance b71ad769-1afe-49ae-83d5-07e64f9e4f0c could not be found. Jul 04 06:29:26.590720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': 'b71ad769-1afe-49ae-83d5-07e64f9e4f0c'} Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71ad769-1afe-49ae-83d5-07e64f9e4f0c could not be found. Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:29:26.591461 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71ad769-1afe-49ae-83d5-07e64f9e4f0c could not be found. Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71ad769-1afe-49ae-83d5-07e64f9e4f0c could not be found. Jul 04 06:29:26.592913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:29:26.593788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-573f6c2c-30cd-45dd-b8d0-dc5072a0226a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Returning 404 to user: Instance b71ad769-1afe-49ae-83d5-07e64f9e4f0c could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:29:26.593788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-573f6c2c-30cd-45dd-b8d0-dc5072a0226a tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c" status: 404 len: 111 microversion: 2.1 time: 0.036785 Jul 04 06:29:26.593788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1054/2125] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:26 2022] GET /compute/v2.1/servers/b71ad769-1afe-49ae-83d5-07e64f9e4f0c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:29:26.599973 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a810087b-2ad3-4814-b270-2cfac993da86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:26.600604 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a810087b-2ad3-4814-b270-2cfac993da86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:26.607617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a810087b-2ad3-4814-b270-2cfac993da86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:26.608136 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a810087b-2ad3-4814-b270-2cfac993da86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:26.608914 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a810087b-2ad3-4814-b270-2cfac993da86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:26.609706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a810087b-2ad3-4814-b270-2cfac993da86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:26.636749 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a810087b-2ad3-4814-b270-2cfac993da86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:29:26.721371 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a810087b-2ad3-4814-b270-2cfac993da86 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 204 len: 0 microversion: 2.1 time: 0.124794 Jul 04 06:29:26.722642 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1072/2126] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:29:26 2022] DELETE /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 06:29:26.731930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a3bbb2e7-d08c-4543-8581-11e1ab80bb69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:26.732762 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a3bbb2e7-d08c-4543-8581-11e1ab80bb69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:26.738997 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3bbb2e7-d08c-4543-8581-11e1ab80bb69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:26.739737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3bbb2e7-d08c-4543-8581-11e1ab80bb69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:26.740512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3bbb2e7-d08c-4543-8581-11e1ab80bb69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:26.740947 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3bbb2e7-d08c-4543-8581-11e1ab80bb69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:26.903554 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a3bbb2e7-d08c-4543-8581-11e1ab80bb69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:26.911699 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a3bbb2e7-d08c-4543-8581-11e1ab80bb69 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1518 microversion: 2.1 time: 0.185118 Jul 04 06:29:26.912257 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1055/2127] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:26 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:29:27.773389 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-0384db88-cd15-44ca-8a2d-82b5c8d11066 req-7841b67e-ef7f-4840-afe1-061cac5c3e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b315f101-8d5d-4b0a-994f-f5c7235ddac6", "name": "network-vif-deleted", "tag": "192d9e0b-c48b-447f-89e4-584619c09143"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:29:27.786269 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-0384db88-cd15-44ca-8a2d-82b5c8d11066 req-7841b67e-ef7f-4840-afe1-061cac5c3e3e service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:27.787144 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-0384db88-cd15-44ca-8a2d-82b5c8d11066 req-7841b67e-ef7f-4840-afe1-061cac5c3e3e service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:27.805425 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-0384db88-cd15-44ca-8a2d-82b5c8d11066 req-7841b67e-ef7f-4840-afe1-061cac5c3e3e service nova] Creating event network-vif-deleted:192d9e0b-c48b-447f-89e4-584619c09143 for instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 on hv-cinder-79733 Jul 04 06:29:27.814333 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-0384db88-cd15-44ca-8a2d-82b5c8d11066 req-7841b67e-ef7f-4840-afe1-061cac5c3e3e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045113 Jul 04 06:29:27.819474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1073/2128] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:29:27.930376 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d6bda8a9-7b5f-4f63-a8e2-de738469aaa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:27.931005 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d6bda8a9-7b5f-4f63-a8e2-de738469aaa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:27.941682 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6bda8a9-7b5f-4f63-a8e2-de738469aaa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:27.942129 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6bda8a9-7b5f-4f63-a8e2-de738469aaa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:27.942910 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6bda8a9-7b5f-4f63-a8e2-de738469aaa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:27.943366 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6bda8a9-7b5f-4f63-a8e2-de738469aaa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:27.979588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6bda8a9-7b5f-4f63-a8e2-de738469aaa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:27.980748 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6bda8a9-7b5f-4f63-a8e2-de738469aaa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:27.981521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-d6bda8a9-7b5f-4f63-a8e2-de738469aaa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lazy-loading 'fault' on Instance uuid b315f101-8d5d-4b0a-994f-f5c7235ddac6 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:29:28.037632 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d6bda8a9-7b5f-4f63-a8e2-de738469aaa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ae888c6e364e2e96ff52e63415a0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aa4fc6d2bd46d3a3492cf0b1d7ae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:28.051330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d6bda8a9-7b5f-4f63-a8e2-de738469aaa2 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 200 len: 1310 microversion: 2.1 time: 0.126317 Jul 04 06:29:28.052116 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1056/2129] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:27 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 1310 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:29:29.071219 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9dcc596-386e-4dae-a29a-8da5d7b78297 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:29.072255 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c9dcc596-386e-4dae-a29a-8da5d7b78297 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] [instance: b315f101-8d5d-4b0a-994f-f5c7235ddac6] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:29.084981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9dcc596-386e-4dae-a29a-8da5d7b78297 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:29.085429 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9dcc596-386e-4dae-a29a-8da5d7b78297 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:29.086390 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9dcc596-386e-4dae-a29a-8da5d7b78297 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:29.089430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9dcc596-386e-4dae-a29a-8da5d7b78297 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:29.109133 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-c9dcc596-386e-4dae-a29a-8da5d7b78297 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] HTTP exception thrown: Instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 could not be found. Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9dcc596-386e-4dae-a29a-8da5d7b78297 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Request method failure captured: Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 HTTP/1.1 Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwoDWduuQd-4LtLNBEsfndOQNnXdCxbhhefkVWxp7Albf8nz6dEzS5A6jt7Yk4-6ho1E-i8y4BxVlVPtK6kmSp7NVCcP2VYorrWW6H95pQXHmX2qA8R11XcUz1Tm7EZIHyhBTnPj1d2JHdR1z7jukPed2TtJYhxuENM3DtP7zltIxXrg Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: 27aa4fc6d2bd46d3a3492cf0b1d7ae9d Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 06:29:29.110787 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_27aa4fc6d2bd46d3a3492cf0b1d7ae9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 27aa4fc6d2bd46d3a3492cf0b1d7ae9d Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1901791098 Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-ServerRescueNegativeTestJSON-1901791098-project Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: 93ae888c6e364e2e96ff52e63415a0e5 Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1901791098-project Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 could not be found. Jul 04 06:29:29.111902 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': 'b315f101-8d5d-4b0a-994f-f5c7235ddac6'} Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 could not be found. Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:29:29.112483 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 could not be found. Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 could not be found. Jul 04 06:29:29.113796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:29:29.114887 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9dcc596-386e-4dae-a29a-8da5d7b78297 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] Returning 404 to user: Instance b315f101-8d5d-4b0a-994f-f5c7235ddac6 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:29:29.114887 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c9dcc596-386e-4dae-a29a-8da5d7b78297 tempest-ServerRescueNegativeTestJSON-1901791098 tempest-ServerRescueNegativeTestJSON-1901791098-project] 10.222.0.42 "GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6" status: 404 len: 111 microversion: 2.1 time: 0.047402 Jul 04 06:29:29.114887 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1074/2130] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:29 2022] GET /compute/v2.1/servers/b315f101-8d5d-4b0a-994f-f5c7235ddac6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:29:53.078452 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-548830435", "imageRef": "6be5f92a-e37c-4bbe-8190-4ff1a2ea6905", "flavorRef": "452"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:29:53.084775 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:29:53.085415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:29:53.136663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] validate_networks() for None {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 06:29:53.424915 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 06:29:53.425340 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 06:29:53.425809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 06:29:53.426214 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 06:29:53.426647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 06:29:53.436283 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:53.436860 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:53.437850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:53.438340 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:53.455266 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Getting quotas for project 8cfe127799e0444d959228abe7ffe5e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 06:29:53.459155 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Getting quotas for user c1785d0b419643aa90fd3e9146a5c6c6 and project 8cfe127799e0444d959228abe7ffe5e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 06:29:53.469831 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 06:29:53.472088 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6be5f92a-e37c-4bbe-8190-4ff1a2ea6905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 06:29:53.519631 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b70fd37-76ea-4d10-aa64-366bc1e8c6f5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.445587 Jul 04 06:29:53.520374 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1057/2131] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 06:29:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 06:29:53.530456 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-de0c5892-3d0f-4965-aa12-f40a4e6dcb24 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:53.531075 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-de0c5892-3d0f-4965-aa12-f40a4e6dcb24 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:53.533731 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:29:53.534551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:29:53.594858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-de0c5892-3d0f-4965-aa12-f40a4e6dcb24 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:53.601640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-de0c5892-3d0f-4965-aa12-f40a4e6dcb24 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1214 microversion: 2.1 time: 0.075019 Jul 04 06:29:53.602218 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1075/2132] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:53 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:29:54.621570 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fec241ec-91d5-427a-875f-55c1371ff2cb tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:54.622191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fec241ec-91d5-427a-875f-55c1371ff2cb tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:54.631890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fec241ec-91d5-427a-875f-55c1371ff2cb tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:54.632336 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fec241ec-91d5-427a-875f-55c1371ff2cb tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:54.633339 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fec241ec-91d5-427a-875f-55c1371ff2cb tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:54.633778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fec241ec-91d5-427a-875f-55c1371ff2cb tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:54.699417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fec241ec-91d5-427a-875f-55c1371ff2cb tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:54.707073 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fec241ec-91d5-427a-875f-55c1371ff2cb tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1218 microversion: 2.1 time: 0.092547 Jul 04 06:29:54.707669 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1058/2133] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:54 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:29:55.728437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a8172d8-7c18-4a91-aaa4-dde4a689302f tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:55.729425 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a8172d8-7c18-4a91-aaa4-dde4a689302f tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:55.741367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a8172d8-7c18-4a91-aaa4-dde4a689302f tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:55.742101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a8172d8-7c18-4a91-aaa4-dde4a689302f tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:55.743348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a8172d8-7c18-4a91-aaa4-dde4a689302f tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:55.744083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a8172d8-7c18-4a91-aaa4-dde4a689302f tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:55.811283 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8a8172d8-7c18-4a91-aaa4-dde4a689302f tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:55.819353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a8172d8-7c18-4a91-aaa4-dde4a689302f tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1210 microversion: 2.1 time: 0.097609 Jul 04 06:29:55.819910 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1076/2134] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:55 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:29:56.837257 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7d574842-3da9-4fc0-bbaf-93e65e88ed31 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:56.838598 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7d574842-3da9-4fc0-bbaf-93e65e88ed31 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:56.847145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d574842-3da9-4fc0-bbaf-93e65e88ed31 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:56.847650 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d574842-3da9-4fc0-bbaf-93e65e88ed31 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:56.848431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d574842-3da9-4fc0-bbaf-93e65e88ed31 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:56.848866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d574842-3da9-4fc0-bbaf-93e65e88ed31 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:56.911622 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d574842-3da9-4fc0-bbaf-93e65e88ed31 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:56.919080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7d574842-3da9-4fc0-bbaf-93e65e88ed31 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1274 microversion: 2.1 time: 0.086226 Jul 04 06:29:56.919667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1059/2135] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:56 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:29:57.936304 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fcada447-46e8-46c4-a3a8-3873f93c0932 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:57.936888 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fcada447-46e8-46c4-a3a8-3873f93c0932 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:57.943915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fcada447-46e8-46c4-a3a8-3873f93c0932 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:57.944353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fcada447-46e8-46c4-a3a8-3873f93c0932 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:57.945118 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fcada447-46e8-46c4-a3a8-3873f93c0932 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:57.945537 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fcada447-46e8-46c4-a3a8-3873f93c0932 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:58.017270 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fcada447-46e8-46c4-a3a8-3873f93c0932 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:58.028353 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fcada447-46e8-46c4-a3a8-3873f93c0932 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1274 microversion: 2.1 time: 0.095689 Jul 04 06:29:58.029118 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1077/2136] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:57 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:29:59.049696 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf79f580-92ee-4f18-acef-011a46434378 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:29:59.050299 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bf79f580-92ee-4f18-acef-011a46434378 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:29:59.057619 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf79f580-92ee-4f18-acef-011a46434378 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:59.058085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf79f580-92ee-4f18-acef-011a46434378 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:59.058879 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf79f580-92ee-4f18-acef-011a46434378 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:29:59.059384 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf79f580-92ee-4f18-acef-011a46434378 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:29:59.126472 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bf79f580-92ee-4f18-acef-011a46434378 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:29:59.135495 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf79f580-92ee-4f18-acef-011a46434378 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1284 microversion: 2.1 time: 0.091970 Jul 04 06:29:59.136670 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1060/2137] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:29:59 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:00.158014 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3305f254-84d2-444a-86fc-4c47b0570590 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:00.159926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3305f254-84d2-444a-86fc-4c47b0570590 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:00.167921 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3305f254-84d2-444a-86fc-4c47b0570590 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:00.168612 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3305f254-84d2-444a-86fc-4c47b0570590 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:00.169513 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3305f254-84d2-444a-86fc-4c47b0570590 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:00.170015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3305f254-84d2-444a-86fc-4c47b0570590 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:00.420039 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3305f254-84d2-444a-86fc-4c47b0570590 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:00.430632 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3305f254-84d2-444a-86fc-4c47b0570590 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1314 microversion: 2.1 time: 0.278895 Jul 04 06:30:00.432246 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1078/2138] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:00 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:01.067036 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-6c2eaff7-4508-41da-8f81-b3c35852d022 req-e324e7b2-512d-48bd-b1c5-b3aebfd88444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16c2a62-842f-42f5-81f5-1815e6c3c2b3", "tag": "6a042ce5-7579-426f-b977-56c02ffbd27b"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:30:01.079518 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6c2eaff7-4508-41da-8f81-b3c35852d022 req-e324e7b2-512d-48bd-b1c5-b3aebfd88444 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:01.079968 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6c2eaff7-4508-41da-8f81-b3c35852d022 req-e324e7b2-512d-48bd-b1c5-b3aebfd88444 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:01.091571 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-6c2eaff7-4508-41da-8f81-b3c35852d022 req-e324e7b2-512d-48bd-b1c5-b3aebfd88444 service nova] Creating event network-changed:6a042ce5-7579-426f-b977-56c02ffbd27b for instance b16c2a62-842f-42f5-81f5-1815e6c3c2b3 on hv-cinder-79733 Jul 04 06:30:01.097338 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-6c2eaff7-4508-41da-8f81-b3c35852d022 req-e324e7b2-512d-48bd-b1c5-b3aebfd88444 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037903 Jul 04 06:30:01.097941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1061/2139] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:30:01.449910 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fe524390-09b2-4de7-bc22-674a47c02015 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:01.450637 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fe524390-09b2-4de7-bc22-674a47c02015 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:01.457867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe524390-09b2-4de7-bc22-674a47c02015 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:01.458518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe524390-09b2-4de7-bc22-674a47c02015 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:01.459422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe524390-09b2-4de7-bc22-674a47c02015 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:01.459922 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe524390-09b2-4de7-bc22-674a47c02015 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:01.614969 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fe524390-09b2-4de7-bc22-674a47c02015 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:01.622670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fe524390-09b2-4de7-bc22-674a47c02015 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1314 microversion: 2.1 time: 0.176635 Jul 04 06:30:01.623276 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1079/2140] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:01 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:02.640645 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-916936e4-cb1f-4fdc-8a51-233cb1392fc8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:02.641417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-916936e4-cb1f-4fdc-8a51-233cb1392fc8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:02.650235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-916936e4-cb1f-4fdc-8a51-233cb1392fc8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:02.650691 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-916936e4-cb1f-4fdc-8a51-233cb1392fc8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:02.651494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-916936e4-cb1f-4fdc-8a51-233cb1392fc8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:02.651930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-916936e4-cb1f-4fdc-8a51-233cb1392fc8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:02.786427 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-916936e4-cb1f-4fdc-8a51-233cb1392fc8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:02.794037 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-916936e4-cb1f-4fdc-8a51-233cb1392fc8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1314 microversion: 2.1 time: 0.157802 Jul 04 06:30:02.794581 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1062/2141] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:02 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:03.812438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8b02e4fe-11c9-4276-b9af-89df2135ad1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:03.813799 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8b02e4fe-11c9-4276-b9af-89df2135ad1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:03.818253 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:30:03.822159 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b02e4fe-11c9-4276-b9af-89df2135ad1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:03.822683 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b02e4fe-11c9-4276-b9af-89df2135ad1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:03.823858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b02e4fe-11c9-4276-b9af-89df2135ad1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:03.824349 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b02e4fe-11c9-4276-b9af-89df2135ad1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:04.106398 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8b02e4fe-11c9-4276-b9af-89df2135ad1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:04.122439 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8b02e4fe-11c9-4276-b9af-89df2135ad1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1314 microversion: 2.1 time: 0.315928 Jul 04 06:30:04.132209 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1080/2142] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:03 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:05.141640 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4edae39f-3ce4-4a2b-9993-faa958398ee7 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:05.142286 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4edae39f-3ce4-4a2b-9993-faa958398ee7 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:05.144398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:30:05.145094 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:30:05.151001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4edae39f-3ce4-4a2b-9993-faa958398ee7 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:05.151591 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4edae39f-3ce4-4a2b-9993-faa958398ee7 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:05.152386 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4edae39f-3ce4-4a2b-9993-faa958398ee7 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:05.152864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4edae39f-3ce4-4a2b-9993-faa958398ee7 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:05.316510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4edae39f-3ce4-4a2b-9993-faa958398ee7 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:05.324334 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4edae39f-3ce4-4a2b-9993-faa958398ee7 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1314 microversion: 2.1 time: 0.186703 Jul 04 06:30:05.325095 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1063/2143] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:05 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:06.341039 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5ae85e3d-e8c7-476e-9fe6-66570d01654c tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:06.341722 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5ae85e3d-e8c7-476e-9fe6-66570d01654c tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:06.348560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ae85e3d-e8c7-476e-9fe6-66570d01654c tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:06.348994 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ae85e3d-e8c7-476e-9fe6-66570d01654c tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:06.349947 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ae85e3d-e8c7-476e-9fe6-66570d01654c tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:06.350379 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ae85e3d-e8c7-476e-9fe6-66570d01654c tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:06.490041 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5ae85e3d-e8c7-476e-9fe6-66570d01654c tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:06.498148 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5ae85e3d-e8c7-476e-9fe6-66570d01654c tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1314 microversion: 2.1 time: 0.160881 Jul 04 06:30:06.498673 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1081/2144] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:06 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:07.530091 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f3ccd578-1848-4f58-9f94-56d400ba7df5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:07.530707 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f3ccd578-1848-4f58-9f94-56d400ba7df5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:07.537791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3ccd578-1848-4f58-9f94-56d400ba7df5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:07.538426 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3ccd578-1848-4f58-9f94-56d400ba7df5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:07.539358 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3ccd578-1848-4f58-9f94-56d400ba7df5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:07.539932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3ccd578-1848-4f58-9f94-56d400ba7df5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:07.742817 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f3ccd578-1848-4f58-9f94-56d400ba7df5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:07.751889 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f3ccd578-1848-4f58-9f94-56d400ba7df5 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1314 microversion: 2.1 time: 0.240151 Jul 04 06:30:07.753254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1064/2145] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:07 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:08.770703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a5990ac2-2cb6-4048-9780-12156cc2d8b8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:08.771289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a5990ac2-2cb6-4048-9780-12156cc2d8b8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:08.781131 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5990ac2-2cb6-4048-9780-12156cc2d8b8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:08.782144 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5990ac2-2cb6-4048-9780-12156cc2d8b8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:08.783531 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5990ac2-2cb6-4048-9780-12156cc2d8b8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:08.784620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5990ac2-2cb6-4048-9780-12156cc2d8b8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:08.934132 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a5990ac2-2cb6-4048-9780-12156cc2d8b8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:08.947411 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a5990ac2-2cb6-4048-9780-12156cc2d8b8 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1314 microversion: 2.1 time: 0.180360 Jul 04 06:30:08.948240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1082/2146] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:08 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:09.964431 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c9e37cf4-22d6-408b-a7a7-cbe5e3737b2a tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:09.965050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c9e37cf4-22d6-408b-a7a7-cbe5e3737b2a tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:09.972987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9e37cf4-22d6-408b-a7a7-cbe5e3737b2a tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:09.973533 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9e37cf4-22d6-408b-a7a7-cbe5e3737b2a tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:09.974557 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9e37cf4-22d6-408b-a7a7-cbe5e3737b2a tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:09.974991 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9e37cf4-22d6-408b-a7a7-cbe5e3737b2a tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:10.149048 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c9e37cf4-22d6-408b-a7a7-cbe5e3737b2a tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:10.157136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c9e37cf4-22d6-408b-a7a7-cbe5e3737b2a tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1314 microversion: 2.1 time: 0.196485 Jul 04 06:30:10.157981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1065/2147] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:09 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:10.979503 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-778172e3-01c6-43a0-a0e9-af9d5dede8cd req-0b0ff82f-259f-4a1e-956b-3c50d9f9019a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16c2a62-842f-42f5-81f5-1815e6c3c2b3", "name": "network-vif-plugged", "status": "completed", "tag": "6a042ce5-7579-426f-b977-56c02ffbd27b"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:30:10.988262 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-778172e3-01c6-43a0-a0e9-af9d5dede8cd req-0b0ff82f-259f-4a1e-956b-3c50d9f9019a service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:10.988789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-778172e3-01c6-43a0-a0e9-af9d5dede8cd req-0b0ff82f-259f-4a1e-956b-3c50d9f9019a service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:11.000072 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-778172e3-01c6-43a0-a0e9-af9d5dede8cd req-0b0ff82f-259f-4a1e-956b-3c50d9f9019a service nova] Creating event network-vif-plugged:6a042ce5-7579-426f-b977-56c02ffbd27b for instance b16c2a62-842f-42f5-81f5-1815e6c3c2b3 on hv-cinder-79733 Jul 04 06:30:11.006330 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-778172e3-01c6-43a0-a0e9-af9d5dede8cd req-0b0ff82f-259f-4a1e-956b-3c50d9f9019a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200425 Jul 04 06:30:11.007345 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1083/2148] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:30:11.175120 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-79205664-fd2d-46a9-b815-2f9d95b6e376 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:11.175995 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-79205664-fd2d-46a9-b815-2f9d95b6e376 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:11.183115 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79205664-fd2d-46a9-b815-2f9d95b6e376 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:11.184089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79205664-fd2d-46a9-b815-2f9d95b6e376 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:11.185051 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79205664-fd2d-46a9-b815-2f9d95b6e376 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:11.185805 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79205664-fd2d-46a9-b815-2f9d95b6e376 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:11.357291 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-79205664-fd2d-46a9-b815-2f9d95b6e376 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:11.367471 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-79205664-fd2d-46a9-b815-2f9d95b6e376 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1314 microversion: 2.1 time: 0.194646 Jul 04 06:30:11.367471 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1066/2149] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:11 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:12.383060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-24320b86-f789-437c-86cf-2cfd80210c34 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:12.383812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-24320b86-f789-437c-86cf-2cfd80210c34 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:12.395624 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24320b86-f789-437c-86cf-2cfd80210c34 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:12.396075 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24320b86-f789-437c-86cf-2cfd80210c34 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:12.396858 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24320b86-f789-437c-86cf-2cfd80210c34 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:12.397436 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24320b86-f789-437c-86cf-2cfd80210c34 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:12.539717 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-24320b86-f789-437c-86cf-2cfd80210c34 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:12.547348 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-24320b86-f789-437c-86cf-2cfd80210c34 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1314 microversion: 2.1 time: 0.168756 Jul 04 06:30:12.547931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1084/2150] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:12 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:13.564161 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6bcd2ed5-bfc2-43bc-9add-3405afabf4db tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:13.565382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6bcd2ed5-bfc2-43bc-9add-3405afabf4db tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:13.577144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bcd2ed5-bfc2-43bc-9add-3405afabf4db tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:13.579584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bcd2ed5-bfc2-43bc-9add-3405afabf4db tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:13.580893 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bcd2ed5-bfc2-43bc-9add-3405afabf4db tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:13.583364 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bcd2ed5-bfc2-43bc-9add-3405afabf4db tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:13.802141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6bcd2ed5-bfc2-43bc-9add-3405afabf4db tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:13.809612 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6bcd2ed5-bfc2-43bc-9add-3405afabf4db tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1463 microversion: 2.1 time: 0.249748 Jul 04 06:30:13.810395 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1067/2151] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:13 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1463 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:13.911297 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0fffcab-c7e9-4a00-b2a1-a256d3dfac1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:13.912147 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0fffcab-c7e9-4a00-b2a1-a256d3dfac1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:13.925370 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0fffcab-c7e9-4a00-b2a1-a256d3dfac1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:13.925914 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0fffcab-c7e9-4a00-b2a1-a256d3dfac1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:13.926763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0fffcab-c7e9-4a00-b2a1-a256d3dfac1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:13.927291 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0fffcab-c7e9-4a00-b2a1-a256d3dfac1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:13.955895 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0fffcab-c7e9-4a00-b2a1-a256d3dfac1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:30:14.091382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0fffcab-c7e9-4a00-b2a1-a256d3dfac1e tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 204 len: 0 microversion: 2.1 time: 0.184162 Jul 04 06:30:14.093343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1085/2152] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:30:13 2022] DELETE /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 06:30:14.101798 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-105948c5-61ab-4993-87a1-cbbce91f8353 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:14.102404 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-105948c5-61ab-4993-87a1-cbbce91f8353 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:14.113829 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105948c5-61ab-4993-87a1-cbbce91f8353 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:14.117675 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105948c5-61ab-4993-87a1-cbbce91f8353 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:14.118512 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105948c5-61ab-4993-87a1-cbbce91f8353 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:14.118955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105948c5-61ab-4993-87a1-cbbce91f8353 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:14.304973 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-105948c5-61ab-4993-87a1-cbbce91f8353 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:14.315127 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-105948c5-61ab-4993-87a1-cbbce91f8353 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1469 microversion: 2.1 time: 0.217306 Jul 04 06:30:14.316406 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1068/2153] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:14 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:15.333400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a6336b5c-daf7-4c6a-8a96-5cc32bd2eada tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:15.334107 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a6336b5c-daf7-4c6a-8a96-5cc32bd2eada tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:15.341438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6336b5c-daf7-4c6a-8a96-5cc32bd2eada tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:15.342021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6336b5c-daf7-4c6a-8a96-5cc32bd2eada tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:15.342893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6336b5c-daf7-4c6a-8a96-5cc32bd2eada tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:15.343472 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6336b5c-daf7-4c6a-8a96-5cc32bd2eada tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:15.479211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a6336b5c-daf7-4c6a-8a96-5cc32bd2eada tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:15.487701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a6336b5c-daf7-4c6a-8a96-5cc32bd2eada tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1469 microversion: 2.1 time: 0.158442 Jul 04 06:30:15.488278 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1086/2154] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:15 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:16.075532 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-1a2844ed-dfbc-4f3a-9b18-802bfc4c7275 req-5c6bd7c3-b9e8-48ab-bb67-e63281ddd8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16c2a62-842f-42f5-81f5-1815e6c3c2b3", "name": "network-vif-deleted", "tag": "6a042ce5-7579-426f-b977-56c02ffbd27b"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:30:16.118984 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-1a2844ed-dfbc-4f3a-9b18-802bfc4c7275 req-5c6bd7c3-b9e8-48ab-bb67-e63281ddd8d6 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:16.125943 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-1a2844ed-dfbc-4f3a-9b18-802bfc4c7275 req-5c6bd7c3-b9e8-48ab-bb67-e63281ddd8d6 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:16.155620 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-1a2844ed-dfbc-4f3a-9b18-802bfc4c7275 req-5c6bd7c3-b9e8-48ab-bb67-e63281ddd8d6 service nova] Creating event network-vif-deleted:6a042ce5-7579-426f-b977-56c02ffbd27b for instance b16c2a62-842f-42f5-81f5-1815e6c3c2b3 on hv-cinder-79733 Jul 04 06:30:16.161755 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-1a2844ed-dfbc-4f3a-9b18-802bfc4c7275 req-5c6bd7c3-b9e8-48ab-bb67-e63281ddd8d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103945 Jul 04 06:30:16.165483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1069/2155] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:30:16.504779 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4346b42e-5482-4d55-9ba5-2878fb694643 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:16.505583 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4346b42e-5482-4d55-9ba5-2878fb694643 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:16.512490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4346b42e-5482-4d55-9ba5-2878fb694643 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:16.512934 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4346b42e-5482-4d55-9ba5-2878fb694643 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:16.513711 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4346b42e-5482-4d55-9ba5-2878fb694643 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:16.514159 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4346b42e-5482-4d55-9ba5-2878fb694643 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:16.551574 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4346b42e-5482-4d55-9ba5-2878fb694643 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:16.552875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4346b42e-5482-4d55-9ba5-2878fb694643 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:16.553703 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-4346b42e-5482-4d55-9ba5-2878fb694643 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lazy-loading 'fault' on Instance uuid b16c2a62-842f-42f5-81f5-1815e6c3c2b3 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:30:16.615820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4346b42e-5482-4d55-9ba5-2878fb694643 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1785d0b419643aa90fd3e9146a5c6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfe127799e0444d959228abe7ffe5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:16.626562 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4346b42e-5482-4d55-9ba5-2878fb694643 tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 200 len: 1304 microversion: 2.1 time: 0.126002 Jul 04 06:30:16.627963 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1087/2156] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:16 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:17.645254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b3c73277-2ac7-4605-9416-d68f800eb1ba tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:17.645957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b3c73277-2ac7-4605-9416-d68f800eb1ba tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] [instance: b16c2a62-842f-42f5-81f5-1815e6c3c2b3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:17.652379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3c73277-2ac7-4605-9416-d68f800eb1ba tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:17.652850 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3c73277-2ac7-4605-9416-d68f800eb1ba tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:17.653599 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3c73277-2ac7-4605-9416-d68f800eb1ba tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:17.654068 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3c73277-2ac7-4605-9416-d68f800eb1ba tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:17.667524 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-b3c73277-2ac7-4605-9416-d68f800eb1ba tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] HTTP exception thrown: Instance b16c2a62-842f-42f5-81f5-1815e6c3c2b3 could not be found. Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b3c73277-2ac7-4605-9416-d68f800eb1ba tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Request method failure captured: Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 HTTP/1.1 Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwojawfttpcGxjkPam9C9rKgdQAqfoBrW8JeeQGHrM1ax8cRKLzWC7sUJjTVJuAlYe3hH2gf_RPEI_JWtRa6jaS0L_0fzjP08WEU7Bb5vzTBruE901Gz5kR29_tfwiSdFeUOc0tJYzkqQCClXm_4Y1j3DRUfpgE4nYgiVR89wbtmQ3jU Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 8cfe127799e0444d959228abe7ffe5e1 Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-778533821 Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:30:17.669163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8cfe127799e0444d959228abe7ffe5e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8cfe127799e0444d959228abe7ffe5e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8cfe127799e0444d959228abe7ffe5e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8cfe127799e0444d959228abe7ffe5e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-778533821 Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 8cfe127799e0444d959228abe7ffe5e1 Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-778533821 Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-778533821-project Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: c1785d0b419643aa90fd3e9146a5c6c6 Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-778533821-project Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance b16c2a62-842f-42f5-81f5-1815e6c3c2b3 could not be found. Jul 04 06:30:17.670521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': 'b16c2a62-842f-42f5-81f5-1815e6c3c2b3'} Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16c2a62-842f-42f5-81f5-1815e6c3c2b3 could not be found. Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:30:17.671222 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16c2a62-842f-42f5-81f5-1815e6c3c2b3 could not be found. Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16c2a62-842f-42f5-81f5-1815e6c3c2b3 could not be found. Jul 04 06:30:17.672651 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:30:17.673793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b3c73277-2ac7-4605-9416-d68f800eb1ba tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] Returning 404 to user: Instance b16c2a62-842f-42f5-81f5-1815e6c3c2b3 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:30:17.673793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b3c73277-2ac7-4605-9416-d68f800eb1ba tempest-VolumesNegativeTest-778533821 tempest-VolumesNegativeTest-778533821-project] 10.222.0.42 "GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3" status: 404 len: 111 microversion: 2.1 time: 0.030574 Jul 04 06:30:17.673793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1070/2157] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:17 2022] GET /compute/v2.1/servers/b16c2a62-842f-42f5-81f5-1815e6c3c2b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:30:33.357544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:30:33.360406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:30:33.813745 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a5edf552-384c-46a4-a426-6d22b632b692 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Action: 'create', calling method: .version_select at 0x7f204fd1ee50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1694803443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHACL9lHIU+ViGuR7DBOjtiTOsp9r+Pf34fGKdftynG9n17ZvrLQHStF6+7shq0pmvcwMUyCNN3lpB/mYS5Hs7qOxylI2xldDyHYtIT2gZybMq3uXhdU01mPwWe3bjCe1A=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:30:33.847563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-a5edf552-384c-46a4-a426-6d22b632b692 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Getting quotas for project e72c59146021441f836a3b822b9c1d1e. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 06:30:33.860267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-a5edf552-384c-46a4-a426-6d22b632b692 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Getting quotas for user dcfeaad253164dfe96a0ff1c3a578609 and project e72c59146021441f836a3b822b9c1d1e. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 06:30:33.913320 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a5edf552-384c-46a4-a426-6d22b632b692 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.575182 Jul 04 06:30:33.914467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1088/2158] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jul 4 06:30:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:30:45.800064 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:30:45.800686 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:30:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:30:51.564608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1943617535", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1694803443", "security_groups": [{"name": "tempest-secgroup-smoke-1783044581"}], "networks": [{"uuid": "5f361518-c4ec-4bc1-9c96-4212d8c6a6a6"}], "block_device_mapping_v2": [{"uuid": "62280434-51a9-4d7a-b990-1c857a4d8e91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:30:51.573715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:30:51.574394 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=68 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:30:51.704190 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] validate_networks() for [('5f361518-c4ec-4bc1-9c96-4212d8c6a6a6', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 06:30:52.069087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:30:52.070292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:30:52.074656 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1dd4b45a-7787-4c02-b316-77c38358a784 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Action: 'create', calling method: .version_select at 0x7f204fd7daf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-139990029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFPfo9A2baW/LWqnzG4ptM3HVDkD+aYZ3CZAbQ0PfYwrZsckWBkVWDcxpldGJqgx/BMN82/rSf/wv8/ln1EmO0prygjDv/scV93eDH6nQgG83IcBb/h1LZll/bIZvkfHQ=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:30:52.090768 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-1dd4b45a-7787-4c02-b316-77c38358a784 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Getting quotas for project 764c6dcba64244dba2aff169c181ccea. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 06:30:52.094691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-1dd4b45a-7787-4c02-b316-77c38358a784 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Getting quotas for user 82e1f29c9cda427cac832f4481fd0b26 and project 764c6dcba64244dba2aff169c181ccea. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 06:30:52.119595 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1dd4b45a-7787-4c02-b316-77c38358a784 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051865 Jul 04 06:30:52.120220 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1089/2159] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jul 4 06:30:52 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:30:52.208720 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 06:30:52.209233 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 06:30:52.209736 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 06:30:52.210146 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 06:30:52.210559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 06:30:52.219547 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:52.219996 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:52.220965 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:52.221403 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:52.221569 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-658408008", "imageRef": "15ce224a-6456-41ea-9158-e78fc3f99d13", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-139990029", "networks": [{"uuid": "3edf83ce-d5bb-47f1-817f-2b965c81578c"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:30:52.238341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Getting quotas for project e72c59146021441f836a3b822b9c1d1e. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 06:30:52.242430 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Getting quotas for user dcfeaad253164dfe96a0ff1c3a578609 and project e72c59146021441f836a3b822b9c1d1e. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 06:30:52.271406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] validate_networks() for [('3edf83ce-d5bb-47f1-817f-2b965c81578c', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 06:30:52.300200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 06:30:52.302249 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62280434-51a9-4d7a-b990-1c857a4d8e91',volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 06:30:52.439404 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ed6de79e-7d5c-4ea0-8e66-c9c4b6c933ca tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.878737 Jul 04 06:30:52.439972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1071/2160] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 06:30:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 06:30:52.449752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-00caf6c2-1577-4f75-9f55-f014b6d2cb89 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:52.450368 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-00caf6c2-1577-4f75-9f55-f014b6d2cb89 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:52.504877 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-00caf6c2-1577-4f75-9f55-f014b6d2cb89 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:52.512195 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-00caf6c2-1577-4f75-9f55-f014b6d2cb89 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1089 microversion: 2.1 time: 0.066057 Jul 04 06:30:52.512790 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1072/2161] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:52 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:52.716563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 06:30:52.716985 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 06:30:52.717458 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 06:30:52.717870 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 06:30:52.718275 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 06:30:52.727819 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:52.728270 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:52.729064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:52.729498 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:52.746198 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Getting quotas for project 764c6dcba64244dba2aff169c181ccea. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 06:30:52.750491 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Getting quotas for user 82e1f29c9cda427cac832f4481fd0b26 and project 764c6dcba64244dba2aff169c181ccea. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 06:30:52.762949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 06:30:52.765190 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15ce224a-6456-41ea-9158-e78fc3f99d13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 06:30:52.824956 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e522e1c9-f046-489f-8779-4017fc99f7ff tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607255 Jul 04 06:30:52.825627 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1090/2162] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jul 4 06:30:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 06:30:52.835559 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0712cdaa-c998-4485-a403-47e40dbee4a3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:52.836247 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0712cdaa-c998-4485-a403-47e40dbee4a3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:52.891980 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0712cdaa-c998-4485-a403-47e40dbee4a3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:52.899414 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0712cdaa-c998-4485-a403-47e40dbee4a3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1257 microversion: 2.1 time: 0.067709 Jul 04 06:30:52.899971 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1073/2163] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:52 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:53.530685 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-97c52e16-78a9-45be-950e-e5538452ec2f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:53.531414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-97c52e16-78a9-45be-950e-e5538452ec2f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:53.594855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-97c52e16-78a9-45be-950e-e5538452ec2f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:53.601763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-97c52e16-78a9-45be-950e-e5538452ec2f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1089 microversion: 2.1 time: 0.075469 Jul 04 06:30:53.602331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1091/2164] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:53 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:53.917033 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e684e33-b157-4dbf-821d-bef36f7b9eee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:53.917685 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e684e33-b157-4dbf-821d-bef36f7b9eee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:53.973863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6e684e33-b157-4dbf-821d-bef36f7b9eee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:53.980746 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e684e33-b157-4dbf-821d-bef36f7b9eee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1257 microversion: 2.1 time: 0.067702 Jul 04 06:30:53.981321 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1074/2165] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:53 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:54.618228 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d52ee8f7-e209-4ea3-a5ef-ca1f2e3de2e9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:54.618795 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d52ee8f7-e209-4ea3-a5ef-ca1f2e3de2e9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:54.625563 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d52ee8f7-e209-4ea3-a5ef-ca1f2e3de2e9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:54.626365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d52ee8f7-e209-4ea3-a5ef-ca1f2e3de2e9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:54.627119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d52ee8f7-e209-4ea3-a5ef-ca1f2e3de2e9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:54.627576 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d52ee8f7-e209-4ea3-a5ef-ca1f2e3de2e9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:54.688323 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d52ee8f7-e209-4ea3-a5ef-ca1f2e3de2e9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:54.696180 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d52ee8f7-e209-4ea3-a5ef-ca1f2e3de2e9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1139 microversion: 2.1 time: 0.081785 Jul 04 06:30:54.696673 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1092/2166] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:54 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:54.996909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0ca0318-8202-4c50-aaa4-d459117bfc85 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:54.997523 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f0ca0318-8202-4c50-aaa4-d459117bfc85 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:55.057931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f0ca0318-8202-4c50-aaa4-d459117bfc85 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:55.066678 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f0ca0318-8202-4c50-aaa4-d459117bfc85 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1257 microversion: 2.1 time: 0.073542 Jul 04 06:30:55.067264 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1075/2167] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:54 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1257 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:55.718821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-141e5681-5484-45d8-a0c6-8c06d19dc2cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:55.719874 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-141e5681-5484-45d8-a0c6-8c06d19dc2cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:55.727127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-141e5681-5484-45d8-a0c6-8c06d19dc2cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:55.727605 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-141e5681-5484-45d8-a0c6-8c06d19dc2cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:55.728363 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-141e5681-5484-45d8-a0c6-8c06d19dc2cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:55.728789 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-141e5681-5484-45d8-a0c6-8c06d19dc2cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:55.804641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-141e5681-5484-45d8-a0c6-8c06d19dc2cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:55.815417 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-141e5681-5484-45d8-a0c6-8c06d19dc2cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1205 microversion: 2.1 time: 0.103034 Jul 04 06:30:55.816337 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1093/2168] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:55 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1205 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:56.084071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-52dcca7c-2296-41e2-9ab4-7ce977641672 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:56.085886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-52dcca7c-2296-41e2-9ab4-7ce977641672 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:56.094152 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52dcca7c-2296-41e2-9ab4-7ce977641672 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:56.095043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52dcca7c-2296-41e2-9ab4-7ce977641672 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:56.096483 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52dcca7c-2296-41e2-9ab4-7ce977641672 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:56.097076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52dcca7c-2296-41e2-9ab4-7ce977641672 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:56.202447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-52dcca7c-2296-41e2-9ab4-7ce977641672 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:56.213795 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-52dcca7c-2296-41e2-9ab4-7ce977641672 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1315 microversion: 2.1 time: 0.133731 Jul 04 06:30:56.216547 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1076/2169] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:56 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1315 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:56.834332 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-40cc816c-ce27-43f8-8581-c5dce882b5ea tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:56.835670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-40cc816c-ce27-43f8-8581-c5dce882b5ea tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:56.852633 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40cc816c-ce27-43f8-8581-c5dce882b5ea tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:56.853254 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40cc816c-ce27-43f8-8581-c5dce882b5ea tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:56.857578 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40cc816c-ce27-43f8-8581-c5dce882b5ea tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:56.859048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40cc816c-ce27-43f8-8581-c5dce882b5ea tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:57.234764 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-17064066-2869-4541-857b-0d024d06fbcc tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:57.236330 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-17064066-2869-4541-857b-0d024d06fbcc tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:57.243548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17064066-2869-4541-857b-0d024d06fbcc tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:57.244662 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17064066-2869-4541-857b-0d024d06fbcc tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:57.245654 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17064066-2869-4541-857b-0d024d06fbcc tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:57.254999 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17064066-2869-4541-857b-0d024d06fbcc tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:57.362527 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40cc816c-ce27-43f8-8581-c5dce882b5ea tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:57.381876 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-40cc816c-ce27-43f8-8581-c5dce882b5ea tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.553252 Jul 04 06:30:57.382658 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1094/2170] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:56 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:57.598815 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-3c9e1093-9709-4e85-b13e-9c480e2f1191 req-fa4dbd06-8ca4-4c84-b232-6ca653b8bfff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe8d554-ad9e-48f8-909a-a07fd4cc63da", "tag": "97e1d096-0047-4462-b327-16383878a1c0"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:30:57.621553 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-3c9e1093-9709-4e85-b13e-9c480e2f1191 req-fa4dbd06-8ca4-4c84-b232-6ca653b8bfff service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:57.622139 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-3c9e1093-9709-4e85-b13e-9c480e2f1191 req-fa4dbd06-8ca4-4c84-b232-6ca653b8bfff service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:57.643641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-3c9e1093-9709-4e85-b13e-9c480e2f1191 req-fa4dbd06-8ca4-4c84-b232-6ca653b8bfff service nova] Creating event network-changed:97e1d096-0047-4462-b327-16383878a1c0 for instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da on hv-cinder-79733 Jul 04 06:30:57.661191 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-3c9e1093-9709-4e85-b13e-9c480e2f1191 req-fa4dbd06-8ca4-4c84-b232-6ca653b8bfff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065115 Jul 04 06:30:57.664067 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1095/2171] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:30:57.736760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-17064066-2869-4541-857b-0d024d06fbcc tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:57.747368 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-17064066-2869-4541-857b-0d024d06fbcc tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.517872 Jul 04 06:30:57.759076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1077/2172] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:57 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:58.400119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2726b34f-b07f-4b4f-94ad-dd58c90d6608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:58.401545 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2726b34f-b07f-4b4f-94ad-dd58c90d6608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:58.429974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2726b34f-b07f-4b4f-94ad-dd58c90d6608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:58.434763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2726b34f-b07f-4b4f-94ad-dd58c90d6608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:58.437900 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2726b34f-b07f-4b4f-94ad-dd58c90d6608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:58.439740 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2726b34f-b07f-4b4f-94ad-dd58c90d6608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:58.638079 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2726b34f-b07f-4b4f-94ad-dd58c90d6608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:58.647352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2726b34f-b07f-4b4f-94ad-dd58c90d6608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.251979 Jul 04 06:30:58.648652 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1096/2173] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:58 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:58.683193 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-57372af7-ce4e-483e-be24-0ee3b86656d4 req-571c6112-ac17-48a6-929f-ab3f2177f39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3531d45-3bff-4ee2-8e4b-864007259a1f", "tag": "d9231dd0-f5a8-4f6d-9dfd-c88717155b60"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:30:58.693132 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-57372af7-ce4e-483e-be24-0ee3b86656d4 req-571c6112-ac17-48a6-929f-ab3f2177f39b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:58.693638 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-57372af7-ce4e-483e-be24-0ee3b86656d4 req-571c6112-ac17-48a6-929f-ab3f2177f39b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:58.705303 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-57372af7-ce4e-483e-be24-0ee3b86656d4 req-571c6112-ac17-48a6-929f-ab3f2177f39b service nova] Creating event network-changed:d9231dd0-f5a8-4f6d-9dfd-c88717155b60 for instance b3531d45-3bff-4ee2-8e4b-864007259a1f on hv-cinder-79733 Jul 04 06:30:58.710356 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-57372af7-ce4e-483e-be24-0ee3b86656d4 req-571c6112-ac17-48a6-929f-ab3f2177f39b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315195 Jul 04 06:30:58.710950 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1078/2174] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:30:58.768091 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-143c5f66-2eb6-44e3-9246-defb5850f3c9 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:58.770793 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-143c5f66-2eb6-44e3-9246-defb5850f3c9 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:58.781572 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-143c5f66-2eb6-44e3-9246-defb5850f3c9 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:58.787811 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-143c5f66-2eb6-44e3-9246-defb5850f3c9 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:58.789002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-143c5f66-2eb6-44e3-9246-defb5850f3c9 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:58.789518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-143c5f66-2eb6-44e3-9246-defb5850f3c9 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:58.935452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-143c5f66-2eb6-44e3-9246-defb5850f3c9 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:58.943593 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-143c5f66-2eb6-44e3-9246-defb5850f3c9 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.181410 Jul 04 06:30:58.944176 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1097/2175] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:58 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:59.670159 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8d936a1-5d11-44e5-bcfd-7fe1eb7a88c1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:59.671556 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8d936a1-5d11-44e5-bcfd-7fe1eb7a88c1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:59.679114 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8d936a1-5d11-44e5-bcfd-7fe1eb7a88c1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:59.679589 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8d936a1-5d11-44e5-bcfd-7fe1eb7a88c1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:59.680359 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8d936a1-5d11-44e5-bcfd-7fe1eb7a88c1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:59.680793 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8d936a1-5d11-44e5-bcfd-7fe1eb7a88c1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:59.832774 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8d936a1-5d11-44e5-bcfd-7fe1eb7a88c1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:30:59.840975 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8d936a1-5d11-44e5-bcfd-7fe1eb7a88c1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.178622 Jul 04 06:30:59.841534 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1079/2176] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:59 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:30:59.960318 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-90fc2ed5-15c9-4e65-a98e-ddf94f810e0d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:30:59.960977 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-90fc2ed5-15c9-4e65-a98e-ddf94f810e0d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:30:59.967933 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90fc2ed5-15c9-4e65-a98e-ddf94f810e0d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:59.968381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90fc2ed5-15c9-4e65-a98e-ddf94f810e0d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:30:59.969150 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90fc2ed5-15c9-4e65-a98e-ddf94f810e0d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:30:59.969585 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90fc2ed5-15c9-4e65-a98e-ddf94f810e0d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:00.113312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-90fc2ed5-15c9-4e65-a98e-ddf94f810e0d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:00.126709 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-90fc2ed5-15c9-4e65-a98e-ddf94f810e0d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.170127 Jul 04 06:31:00.127500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1098/2177] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:30:59 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:00.859047 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-77da1df7-cad0-485c-9df0-4db33833eb6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:00.860588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-77da1df7-cad0-485c-9df0-4db33833eb6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:00.868928 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77da1df7-cad0-485c-9df0-4db33833eb6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:00.869823 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77da1df7-cad0-485c-9df0-4db33833eb6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:00.870966 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77da1df7-cad0-485c-9df0-4db33833eb6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:00.871780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77da1df7-cad0-485c-9df0-4db33833eb6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:01.020769 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-77da1df7-cad0-485c-9df0-4db33833eb6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:01.028529 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-77da1df7-cad0-485c-9df0-4db33833eb6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.174011 Jul 04 06:31:01.037907 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1080/2178] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:00 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:01.147930 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42fbd032-5022-4d0a-be60-e0ded5b7b7b6 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:01.148968 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-42fbd032-5022-4d0a-be60-e0ded5b7b7b6 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:01.159472 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42fbd032-5022-4d0a-be60-e0ded5b7b7b6 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:01.160231 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42fbd032-5022-4d0a-be60-e0ded5b7b7b6 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:01.161323 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42fbd032-5022-4d0a-be60-e0ded5b7b7b6 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:01.161793 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42fbd032-5022-4d0a-be60-e0ded5b7b7b6 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:01.300808 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-42fbd032-5022-4d0a-be60-e0ded5b7b7b6 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:01.309792 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-42fbd032-5022-4d0a-be60-e0ded5b7b7b6 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.168460 Jul 04 06:31:01.310719 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1099/2179] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:01 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:02.049080 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-38020fd1-770e-4f33-9c28-51ea9865f8b2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:02.049713 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-38020fd1-770e-4f33-9c28-51ea9865f8b2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:02.059932 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38020fd1-770e-4f33-9c28-51ea9865f8b2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:02.060569 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38020fd1-770e-4f33-9c28-51ea9865f8b2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:02.061627 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38020fd1-770e-4f33-9c28-51ea9865f8b2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:02.062272 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38020fd1-770e-4f33-9c28-51ea9865f8b2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:02.200821 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-38020fd1-770e-4f33-9c28-51ea9865f8b2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:02.208254 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-38020fd1-770e-4f33-9c28-51ea9865f8b2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.165409 Jul 04 06:31:02.208810 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1081/2180] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:02 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:02.331868 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fe436dab-8d96-422c-a5ed-79a7f6415219 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:02.333478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fe436dab-8d96-422c-a5ed-79a7f6415219 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:02.342289 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe436dab-8d96-422c-a5ed-79a7f6415219 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:02.342835 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe436dab-8d96-422c-a5ed-79a7f6415219 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:02.343666 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe436dab-8d96-422c-a5ed-79a7f6415219 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:02.344172 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe436dab-8d96-422c-a5ed-79a7f6415219 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:02.488792 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fe436dab-8d96-422c-a5ed-79a7f6415219 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:02.497550 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fe436dab-8d96-422c-a5ed-79a7f6415219 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.170699 Jul 04 06:31:02.498638 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1100/2181] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:02 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:03.222450 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:03.227930 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1db6b11b-0019-4a46-9d4b-1fef8724c682 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:03.228977 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1db6b11b-0019-4a46-9d4b-1fef8724c682 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:03.245630 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1db6b11b-0019-4a46-9d4b-1fef8724c682 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:03.246447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1db6b11b-0019-4a46-9d4b-1fef8724c682 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:03.247503 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1db6b11b-0019-4a46-9d4b-1fef8724c682 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:03.248141 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1db6b11b-0019-4a46-9d4b-1fef8724c682 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:03.394257 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1db6b11b-0019-4a46-9d4b-1fef8724c682 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:03.403137 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1db6b11b-0019-4a46-9d4b-1fef8724c682 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.181473 Jul 04 06:31:03.414663 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1082/2182] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:03 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:03.516075 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-014ca072-2c5d-499a-9299-d77ede56a335 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:03.516691 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-014ca072-2c5d-499a-9299-d77ede56a335 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:03.519861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:03.525152 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-014ca072-2c5d-499a-9299-d77ede56a335 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:03.525601 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-014ca072-2c5d-499a-9299-d77ede56a335 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:03.526385 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-014ca072-2c5d-499a-9299-d77ede56a335 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:03.526823 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-014ca072-2c5d-499a-9299-d77ede56a335 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:03.599408 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=12 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:03.668171 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-014ca072-2c5d-499a-9299-d77ede56a335 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:03.675871 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-014ca072-2c5d-499a-9299-d77ede56a335 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.163683 Jul 04 06:31:03.676488 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1101/2183] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:03 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:04.422874 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-066341c3-e5b7-4303-9519-0446ab6ce335 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:04.423544 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-066341c3-e5b7-4303-9519-0446ab6ce335 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:04.432295 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-066341c3-e5b7-4303-9519-0446ab6ce335 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:04.432896 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-066341c3-e5b7-4303-9519-0446ab6ce335 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:04.434089 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-066341c3-e5b7-4303-9519-0446ab6ce335 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:04.434689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-066341c3-e5b7-4303-9519-0446ab6ce335 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:04.581981 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-066341c3-e5b7-4303-9519-0446ab6ce335 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:04.590237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-066341c3-e5b7-4303-9519-0446ab6ce335 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.173372 Jul 04 06:31:04.591043 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1083/2184] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:04 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:04.693505 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-57b1cdb8-fd5b-403a-849b-02a2a7ac58ee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:04.694105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-57b1cdb8-fd5b-403a-849b-02a2a7ac58ee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:04.700937 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57b1cdb8-fd5b-403a-849b-02a2a7ac58ee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:04.701381 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57b1cdb8-fd5b-403a-849b-02a2a7ac58ee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:04.702127 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57b1cdb8-fd5b-403a-849b-02a2a7ac58ee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:04.702558 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57b1cdb8-fd5b-403a-849b-02a2a7ac58ee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:04.841848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-57b1cdb8-fd5b-403a-849b-02a2a7ac58ee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:04.850217 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-57b1cdb8-fd5b-403a-849b-02a2a7ac58ee tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.160624 Jul 04 06:31:04.850796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1102/2185] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:04 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:05.607274 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-24b5c4a1-a62c-4f0c-9169-c6c838f49e1c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:05.607866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-24b5c4a1-a62c-4f0c-9169-c6c838f49e1c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:05.609937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=14 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:05.615580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24b5c4a1-a62c-4f0c-9169-c6c838f49e1c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:05.616025 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24b5c4a1-a62c-4f0c-9169-c6c838f49e1c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:05.616804 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24b5c4a1-a62c-4f0c-9169-c6c838f49e1c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:05.617232 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24b5c4a1-a62c-4f0c-9169-c6c838f49e1c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:05.764320 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-24b5c4a1-a62c-4f0c-9169-c6c838f49e1c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:05.772092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-24b5c4a1-a62c-4f0c-9169-c6c838f49e1c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.168617 Jul 04 06:31:05.772547 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1084/2186] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:05 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:05.872490 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a086d56e-078c-4f20-9256-9d6f056b6147 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:05.873105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a086d56e-078c-4f20-9256-9d6f056b6147 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:05.881592 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a086d56e-078c-4f20-9256-9d6f056b6147 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:05.882245 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a086d56e-078c-4f20-9256-9d6f056b6147 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:05.883182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a086d56e-078c-4f20-9256-9d6f056b6147 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:05.883639 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a086d56e-078c-4f20-9256-9d6f056b6147 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:06.026164 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a086d56e-078c-4f20-9256-9d6f056b6147 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:06.037865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a086d56e-078c-4f20-9256-9d6f056b6147 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.169137 Jul 04 06:31:06.038697 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1103/2187] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:05 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:06.789136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-02675048-638a-4214-80d0-ddeae83849bd tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:06.789769 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-02675048-638a-4214-80d0-ddeae83849bd tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:06.796603 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02675048-638a-4214-80d0-ddeae83849bd tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:06.797098 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02675048-638a-4214-80d0-ddeae83849bd tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:06.797873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02675048-638a-4214-80d0-ddeae83849bd tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:06.798306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02675048-638a-4214-80d0-ddeae83849bd tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:06.966689 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-02675048-638a-4214-80d0-ddeae83849bd tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:06.974590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-02675048-638a-4214-80d0-ddeae83849bd tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.189500 Jul 04 06:31:06.975167 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1085/2188] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:06 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:07.068971 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7a468db4-7f81-4aa5-a62b-68e646c40f57 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:07.069803 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7a468db4-7f81-4aa5-a62b-68e646c40f57 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:07.080818 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a468db4-7f81-4aa5-a62b-68e646c40f57 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:07.082372 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a468db4-7f81-4aa5-a62b-68e646c40f57 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:07.082990 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a468db4-7f81-4aa5-a62b-68e646c40f57 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:07.083506 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a468db4-7f81-4aa5-a62b-68e646c40f57 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:07.265358 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7a468db4-7f81-4aa5-a62b-68e646c40f57 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:07.274346 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7a468db4-7f81-4aa5-a62b-68e646c40f57 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.212476 Jul 04 06:31:07.275162 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1104/2189] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:07 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:07.995832 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9be51113-7b89-48b7-b812-dfa4ae19cfc1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:07.996828 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9be51113-7b89-48b7-b812-dfa4ae19cfc1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:08.007083 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9be51113-7b89-48b7-b812-dfa4ae19cfc1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:08.007556 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9be51113-7b89-48b7-b812-dfa4ae19cfc1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:08.008310 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9be51113-7b89-48b7-b812-dfa4ae19cfc1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:08.008738 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9be51113-7b89-48b7-b812-dfa4ae19cfc1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:08.151016 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9be51113-7b89-48b7-b812-dfa4ae19cfc1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:08.162267 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9be51113-7b89-48b7-b812-dfa4ae19cfc1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.173014 Jul 04 06:31:08.162809 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1086/2190] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:07 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:08.292332 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fd56c717-0c38-4023-a094-5791d901118d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:08.292904 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fd56c717-0c38-4023-a094-5791d901118d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:08.302079 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd56c717-0c38-4023-a094-5791d901118d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:08.302548 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd56c717-0c38-4023-a094-5791d901118d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:08.303344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd56c717-0c38-4023-a094-5791d901118d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:08.303780 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd56c717-0c38-4023-a094-5791d901118d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:08.453502 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fd56c717-0c38-4023-a094-5791d901118d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:08.461438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fd56c717-0c38-4023-a094-5791d901118d tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.173339 Jul 04 06:31:08.462015 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1105/2191] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:08 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:09.181300 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5cd62f4f-2f16-4098-8dbf-5268f04670f1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:09.181906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5cd62f4f-2f16-4098-8dbf-5268f04670f1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:09.188974 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5cd62f4f-2f16-4098-8dbf-5268f04670f1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:09.189415 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5cd62f4f-2f16-4098-8dbf-5268f04670f1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:09.190168 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5cd62f4f-2f16-4098-8dbf-5268f04670f1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:09.190596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5cd62f4f-2f16-4098-8dbf-5268f04670f1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:09.330412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5cd62f4f-2f16-4098-8dbf-5268f04670f1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:09.338119 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5cd62f4f-2f16-4098-8dbf-5268f04670f1 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.161246 Jul 04 06:31:09.338694 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1087/2192] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:09 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:09.488509 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-af8e8d68-28ae-4038-ab91-5a97de5dc13a tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:09.489575 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-af8e8d68-28ae-4038-ab91-5a97de5dc13a tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:09.504707 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af8e8d68-28ae-4038-ab91-5a97de5dc13a tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:09.505503 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af8e8d68-28ae-4038-ab91-5a97de5dc13a tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:09.506471 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af8e8d68-28ae-4038-ab91-5a97de5dc13a tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:09.506901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af8e8d68-28ae-4038-ab91-5a97de5dc13a tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:09.643110 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-af8e8d68-28ae-4038-ab91-5a97de5dc13a tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:09.654633 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-af8e8d68-28ae-4038-ab91-5a97de5dc13a tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.172335 Jul 04 06:31:09.655414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1106/2193] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:09 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:10.359122 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f26f885-2f9d-4d9e-90ff-08ce94c0f218 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:10.360097 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9f26f885-2f9d-4d9e-90ff-08ce94c0f218 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:10.371120 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f26f885-2f9d-4d9e-90ff-08ce94c0f218 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:10.371955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f26f885-2f9d-4d9e-90ff-08ce94c0f218 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:10.373183 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f26f885-2f9d-4d9e-90ff-08ce94c0f218 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:10.373906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f26f885-2f9d-4d9e-90ff-08ce94c0f218 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:10.514838 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9f26f885-2f9d-4d9e-90ff-08ce94c0f218 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:10.522807 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9f26f885-2f9d-4d9e-90ff-08ce94c0f218 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.170211 Jul 04 06:31:10.523400 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1088/2194] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:10 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:10.674216 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa36f5c6-f95e-4061-b386-1463b6c8479e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:10.674765 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aa36f5c6-f95e-4061-b386-1463b6c8479e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:10.682002 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa36f5c6-f95e-4061-b386-1463b6c8479e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:10.682447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa36f5c6-f95e-4061-b386-1463b6c8479e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:10.683197 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa36f5c6-f95e-4061-b386-1463b6c8479e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:10.683655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa36f5c6-f95e-4061-b386-1463b6c8479e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:10.817915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aa36f5c6-f95e-4061-b386-1463b6c8479e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:10.829952 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aa36f5c6-f95e-4061-b386-1463b6c8479e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.159629 Jul 04 06:31:10.830723 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1107/2195] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:10 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:11.540715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-46d73f22-0ad6-4227-873a-bef209f695d9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:11.541237 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-46d73f22-0ad6-4227-873a-bef209f695d9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:11.548398 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46d73f22-0ad6-4227-873a-bef209f695d9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:11.548852 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46d73f22-0ad6-4227-873a-bef209f695d9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:11.549756 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46d73f22-0ad6-4227-873a-bef209f695d9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:11.550198 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46d73f22-0ad6-4227-873a-bef209f695d9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:11.685290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-46d73f22-0ad6-4227-873a-bef209f695d9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:11.693050 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-46d73f22-0ad6-4227-873a-bef209f695d9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.156698 Jul 04 06:31:11.693624 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1089/2196] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:11 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:11.849875 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d2ad7509-1708-4255-b4b2-fa341000d2a8 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:11.850378 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d2ad7509-1708-4255-b4b2-fa341000d2a8 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:11.857367 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2ad7509-1708-4255-b4b2-fa341000d2a8 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:11.857817 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2ad7509-1708-4255-b4b2-fa341000d2a8 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:11.858635 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2ad7509-1708-4255-b4b2-fa341000d2a8 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:11.859069 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d2ad7509-1708-4255-b4b2-fa341000d2a8 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:11.993992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d2ad7509-1708-4255-b4b2-fa341000d2a8 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:11.997452 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:12.002467 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d2ad7509-1708-4255-b4b2-fa341000d2a8 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.157950 Jul 04 06:31:12.003048 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1108/2197] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:11 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:12.716055 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7d65a771-c1ce-4985-8142-3788a45aa375 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:12.716778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7d65a771-c1ce-4985-8142-3788a45aa375 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:12.725443 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d65a771-c1ce-4985-8142-3788a45aa375 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:12.725984 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d65a771-c1ce-4985-8142-3788a45aa375 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:12.727106 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d65a771-c1ce-4985-8142-3788a45aa375 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:12.727701 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d65a771-c1ce-4985-8142-3788a45aa375 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:12.901815 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d65a771-c1ce-4985-8142-3788a45aa375 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:12.914004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7d65a771-c1ce-4985-8142-3788a45aa375 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.205759 Jul 04 06:31:12.914753 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1090/2198] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:12 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:13.024877 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d014832a-48be-4d32-890b-5b3d139057a4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:13.025718 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d014832a-48be-4d32-890b-5b3d139057a4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:13.033804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d014832a-48be-4d32-890b-5b3d139057a4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:13.034256 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d014832a-48be-4d32-890b-5b3d139057a4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:13.035116 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d014832a-48be-4d32-890b-5b3d139057a4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:13.035596 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d014832a-48be-4d32-890b-5b3d139057a4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:13.172458 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-4e0f917d-9054-4ee3-ad9f-b5345cbeba36 req-46ee3456-dea0-4140-8306-59fa36be6522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3531d45-3bff-4ee2-8e4b-864007259a1f", "name": "network-vif-plugged", "status": "completed", "tag": "d9231dd0-f5a8-4f6d-9dfd-c88717155b60"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:31:13.176744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d014832a-48be-4d32-890b-5b3d139057a4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:13.181584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-4e0f917d-9054-4ee3-ad9f-b5345cbeba36 req-46ee3456-dea0-4140-8306-59fa36be6522 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:13.182085 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-4e0f917d-9054-4ee3-ad9f-b5345cbeba36 req-46ee3456-dea0-4140-8306-59fa36be6522 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:13.185331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d014832a-48be-4d32-890b-5b3d139057a4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.164976 Jul 04 06:31:13.186165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1109/2199] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:13 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:13.205470 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-4e0f917d-9054-4ee3-ad9f-b5345cbeba36 req-46ee3456-dea0-4140-8306-59fa36be6522 service nova] Creating event network-vif-plugged:d9231dd0-f5a8-4f6d-9dfd-c88717155b60 for instance b3531d45-3bff-4ee2-8e4b-864007259a1f on hv-cinder-79733 Jul 04 06:31:13.210905 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-4e0f917d-9054-4ee3-ad9f-b5345cbeba36 req-46ee3456-dea0-4140-8306-59fa36be6522 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042444 Jul 04 06:31:13.211608 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1091/2200] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:31:13.941606 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-861b9e8a-dd5c-494e-95b3-9caa8708e5a9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:13.942493 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-861b9e8a-dd5c-494e-95b3-9caa8708e5a9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:13.949101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-861b9e8a-dd5c-494e-95b3-9caa8708e5a9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:13.949551 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-861b9e8a-dd5c-494e-95b3-9caa8708e5a9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:13.950311 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-861b9e8a-dd5c-494e-95b3-9caa8708e5a9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:13.950744 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-861b9e8a-dd5c-494e-95b3-9caa8708e5a9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:14.100016 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-861b9e8a-dd5c-494e-95b3-9caa8708e5a9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:14.108215 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-861b9e8a-dd5c-494e-95b3-9caa8708e5a9 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.173185 Jul 04 06:31:14.108800 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1110/2201] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:13 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:14.209102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-46915ecd-b9eb-442e-9731-da834921fc99 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:14.210138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-46915ecd-b9eb-442e-9731-da834921fc99 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:14.221596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46915ecd-b9eb-442e-9731-da834921fc99 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:14.222346 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46915ecd-b9eb-442e-9731-da834921fc99 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:14.223636 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46915ecd-b9eb-442e-9731-da834921fc99 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:14.224076 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46915ecd-b9eb-442e-9731-da834921fc99 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:14.356781 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-46915ecd-b9eb-442e-9731-da834921fc99 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:14.366133 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-46915ecd-b9eb-442e-9731-da834921fc99 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1357 microversion: 2.1 time: 0.164508 Jul 04 06:31:14.366702 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1092/2202] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:14 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:15.129382 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7d609451-06f3-45de-9114-c03889dddb72 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:15.130438 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7d609451-06f3-45de-9114-c03889dddb72 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:15.141701 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d609451-06f3-45de-9114-c03889dddb72 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:15.142301 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d609451-06f3-45de-9114-c03889dddb72 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:15.143634 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d609451-06f3-45de-9114-c03889dddb72 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:15.144343 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d609451-06f3-45de-9114-c03889dddb72 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:15.283572 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7d609451-06f3-45de-9114-c03889dddb72 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:15.295229 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7d609451-06f3-45de-9114-c03889dddb72 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.172648 Jul 04 06:31:15.296105 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1111/2203] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:15 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:15.392535 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-48d988fb-1455-48f7-a716-d08ea553e6d3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:15.393333 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-48d988fb-1455-48f7-a716-d08ea553e6d3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:15.404760 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48d988fb-1455-48f7-a716-d08ea553e6d3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:15.405518 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48d988fb-1455-48f7-a716-d08ea553e6d3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:15.406770 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48d988fb-1455-48f7-a716-d08ea553e6d3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:15.407538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48d988fb-1455-48f7-a716-d08ea553e6d3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:15.432399 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:15.553184 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48d988fb-1455-48f7-a716-d08ea553e6d3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:15.565300 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-48d988fb-1455-48f7-a716-d08ea553e6d3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1546 microversion: 2.1 time: 0.179109 Jul 04 06:31:15.566153 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1093/2204] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:15 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:15.586070 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d39c6aac-1cd3-439d-8328-6ba6d302875e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:15.586921 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d39c6aac-1cd3-439d-8328-6ba6d302875e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:15.594797 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d39c6aac-1cd3-439d-8328-6ba6d302875e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:15.595275 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d39c6aac-1cd3-439d-8328-6ba6d302875e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:15.596083 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d39c6aac-1cd3-439d-8328-6ba6d302875e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:15.596523 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d39c6aac-1cd3-439d-8328-6ba6d302875e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:15.740441 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d39c6aac-1cd3-439d-8328-6ba6d302875e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:15.748214 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d39c6aac-1cd3-439d-8328-6ba6d302875e tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1546 microversion: 2.1 time: 0.168037 Jul 04 06:31:15.748793 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1112/2205] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:15 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:15.764534 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-81516e17-a85a-41ac-82ed-33efb55b91e1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:15.767934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-81516e17-a85a-41ac-82ed-33efb55b91e1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:15.768710 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-81516e17-a85a-41ac-82ed-33efb55b91e1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Searching by: {'deleted': False, 'project_id': '764c6dcba64244dba2aff169c181ccea'} {{(pid=117606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 04 06:31:15.775844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81516e17-a85a-41ac-82ed-33efb55b91e1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:15.776295 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81516e17-a85a-41ac-82ed-33efb55b91e1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:15.777092 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81516e17-a85a-41ac-82ed-33efb55b91e1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:15.777530 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81516e17-a85a-41ac-82ed-33efb55b91e1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:15.868795 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.multi_cell_list [None req-81516e17-a85a-41ac-82ed-33efb55b91e1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 04 06:31:15.960318 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-81516e17-a85a-41ac-82ed-33efb55b91e1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199470 Jul 04 06:31:15.960819 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1094/2206] 10.222.0.42 () {58 vars in 1124 bytes} [Mon Jul 4 06:31:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:31:15.971231 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1c53b242-2c62-4aca-b33f-a8ce2c5d7c2c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:15.971870 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1c53b242-2c62-4aca-b33f-a8ce2c5d7c2c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:15.978402 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c53b242-2c62-4aca-b33f-a8ce2c5d7c2c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:15.978846 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c53b242-2c62-4aca-b33f-a8ce2c5d7c2c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:15.979654 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c53b242-2c62-4aca-b33f-a8ce2c5d7c2c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:15.980080 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c53b242-2c62-4aca-b33f-a8ce2c5d7c2c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:16.119821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c53b242-2c62-4aca-b33f-a8ce2c5d7c2c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:16.131277 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1c53b242-2c62-4aca-b33f-a8ce2c5d7c2c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1546 microversion: 2.1 time: 0.163860 Jul 04 06:31:16.131848 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1113/2207] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:15 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:16.315545 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-00251955-004a-40d3-8e91-55af958dd174 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:16.316240 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-00251955-004a-40d3-8e91-55af958dd174 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:16.322628 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00251955-004a-40d3-8e91-55af958dd174 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:16.323136 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00251955-004a-40d3-8e91-55af958dd174 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:16.323913 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00251955-004a-40d3-8e91-55af958dd174 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:16.324342 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00251955-004a-40d3-8e91-55af958dd174 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:16.469053 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-00251955-004a-40d3-8e91-55af958dd174 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:16.476870 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-00251955-004a-40d3-8e91-55af958dd174 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.166200 Jul 04 06:31:16.477697 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1095/2208] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:16 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:17.493518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9a23d062-aa27-4850-a2ae-0045c1761c3c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:17.494187 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9a23d062-aa27-4850-a2ae-0045c1761c3c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:17.505197 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a23d062-aa27-4850-a2ae-0045c1761c3c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:17.505733 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a23d062-aa27-4850-a2ae-0045c1761c3c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:17.506824 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a23d062-aa27-4850-a2ae-0045c1761c3c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:17.507488 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a23d062-aa27-4850-a2ae-0045c1761c3c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:17.670259 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9a23d062-aa27-4850-a2ae-0045c1761c3c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:17.679355 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9a23d062-aa27-4850-a2ae-0045c1761c3c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.190154 Jul 04 06:31:17.679944 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1114/2209] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:17 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:17.715001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-85bfe6bb-c186-4b6e-891a-0a5524d6e8be tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e334377-d37a-4f67-86f5-60b952343408"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:31:17.716103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-85bfe6bb-c186-4b6e-891a-0a5524d6e8be tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:17.722556 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85bfe6bb-c186-4b6e-891a-0a5524d6e8be tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:17.723001 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85bfe6bb-c186-4b6e-891a-0a5524d6e8be tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:17.723791 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85bfe6bb-c186-4b6e-891a-0a5524d6e8be tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:17.724281 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85bfe6bb-c186-4b6e-891a-0a5524d6e8be tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:17.981019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-85bfe6bb-c186-4b6e-891a-0a5524d6e8be tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "POST /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269822 Jul 04 06:31:17.981695 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1096/2210] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jul 4 06:31:17 2022] POST /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:31:18.699618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-07486580-61e4-4809-b3de-f5fc24440b82 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:18.700323 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-07486580-61e4-4809-b3de-f5fc24440b82 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:18.709344 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07486580-61e4-4809-b3de-f5fc24440b82 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:18.709796 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07486580-61e4-4809-b3de-f5fc24440b82 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:18.710568 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07486580-61e4-4809-b3de-f5fc24440b82 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:18.711029 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07486580-61e4-4809-b3de-f5fc24440b82 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:18.850194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-07486580-61e4-4809-b3de-f5fc24440b82 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:18.857954 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-07486580-61e4-4809-b3de-f5fc24440b82 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.163734 Jul 04 06:31:18.858527 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1115/2211] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:18 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:19.213701 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-903b569f-1a91-41e6-9786-5c676d338e93 req-8191ac5a-a8ed-4f21-a56f-8a2edf686d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe8d554-ad9e-48f8-909a-a07fd4cc63da", "name": "network-vif-plugged", "status": "completed", "tag": "97e1d096-0047-4462-b327-16383878a1c0"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:31:19.223458 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-903b569f-1a91-41e6-9786-5c676d338e93 req-8191ac5a-a8ed-4f21-a56f-8a2edf686d74 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:19.224074 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-903b569f-1a91-41e6-9786-5c676d338e93 req-8191ac5a-a8ed-4f21-a56f-8a2edf686d74 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:19.235341 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-903b569f-1a91-41e6-9786-5c676d338e93 req-8191ac5a-a8ed-4f21-a56f-8a2edf686d74 service nova] Creating event network-vif-plugged:97e1d096-0047-4462-b327-16383878a1c0 for instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da on hv-cinder-79733 Jul 04 06:31:19.240112 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-903b569f-1a91-41e6-9786-5c676d338e93 req-8191ac5a-a8ed-4f21-a56f-8a2edf686d74 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031025 Jul 04 06:31:19.240711 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1097/2212] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:31:19.881613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-69df253f-196d-4f86-b4bd-63ea415d6d26 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:19.882534 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-69df253f-196d-4f86-b4bd-63ea415d6d26 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:19.890629 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69df253f-196d-4f86-b4bd-63ea415d6d26 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:19.891153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69df253f-196d-4f86-b4bd-63ea415d6d26 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:19.892096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69df253f-196d-4f86-b4bd-63ea415d6d26 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:19.892602 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69df253f-196d-4f86-b4bd-63ea415d6d26 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:20.024476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-69df253f-196d-4f86-b4bd-63ea415d6d26 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:20.032290 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-69df253f-196d-4f86-b4bd-63ea415d6d26 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1261 microversion: 2.1 time: 0.157563 Jul 04 06:31:20.032865 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1116/2213] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:19 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:21.051537 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce1c973f-caad-40b6-93ca-b01f1af83650 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:21.052421 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ce1c973f-caad-40b6-93ca-b01f1af83650 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:21.060538 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce1c973f-caad-40b6-93ca-b01f1af83650 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:21.061099 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce1c973f-caad-40b6-93ca-b01f1af83650 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:21.062062 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce1c973f-caad-40b6-93ca-b01f1af83650 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:21.062612 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce1c973f-caad-40b6-93ca-b01f1af83650 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:21.203780 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce1c973f-caad-40b6-93ca-b01f1af83650 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:21.211429 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce1c973f-caad-40b6-93ca-b01f1af83650 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1445 microversion: 2.1 time: 0.165953 Jul 04 06:31:21.211993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1098/2214] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:21 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1445 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:21.227618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-019d9f2b-720c-47ee-a31e-a77eb09d74f7 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:21.228229 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-019d9f2b-720c-47ee-a31e-a77eb09d74f7 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:21.235474 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-019d9f2b-720c-47ee-a31e-a77eb09d74f7 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:21.235923 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-019d9f2b-720c-47ee-a31e-a77eb09d74f7 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:21.236686 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-019d9f2b-720c-47ee-a31e-a77eb09d74f7 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:21.237158 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-019d9f2b-720c-47ee-a31e-a77eb09d74f7 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:21.384004 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-019d9f2b-720c-47ee-a31e-a77eb09d74f7 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:21.395190 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-019d9f2b-720c-47ee-a31e-a77eb09d74f7 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1445 microversion: 2.1 time: 0.171376 Jul 04 06:31:21.395982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1117/2215] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:21 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1445 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:23.120359 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-738220c3-c77b-4c6f-a196-ba2eee50f226 req-198a6fdd-6663-42b5-825b-7ac54a190afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe8d554-ad9e-48f8-909a-a07fd4cc63da", "tag": "97e1d096-0047-4462-b327-16383878a1c0"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:31:23.124548 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:23.130610 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-738220c3-c77b-4c6f-a196-ba2eee50f226 req-198a6fdd-6663-42b5-825b-7ac54a190afd service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:23.131066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-738220c3-c77b-4c6f-a196-ba2eee50f226 req-198a6fdd-6663-42b5-825b-7ac54a190afd service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:23.143596 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-738220c3-c77b-4c6f-a196-ba2eee50f226 req-198a6fdd-6663-42b5-825b-7ac54a190afd service nova] Creating event network-changed:97e1d096-0047-4462-b327-16383878a1c0 for instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da on hv-cinder-79733 Jul 04 06:31:23.148476 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-738220c3-c77b-4c6f-a196-ba2eee50f226 req-198a6fdd-6663-42b5-825b-7ac54a190afd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031971 Jul 04 06:31:23.149249 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1099/2216] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:31:24.501508 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dc795f0c-8686-496b-94a1-6703175b3045 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:24.502244 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dc795f0c-8686-496b-94a1-6703175b3045 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:24.504582 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:24.510113 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc795f0c-8686-496b-94a1-6703175b3045 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:24.510568 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc795f0c-8686-496b-94a1-6703175b3045 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:24.511377 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc795f0c-8686-496b-94a1-6703175b3045 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:24.511804 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc795f0c-8686-496b-94a1-6703175b3045 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:24.650316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dc795f0c-8686-496b-94a1-6703175b3045 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:24.658913 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dc795f0c-8686-496b-94a1-6703175b3045 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1592 microversion: 2.1 time: 0.161987 Jul 04 06:31:24.659535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1118/2217] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:24 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1592 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:26.669642 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:26.674176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-702d860e-838c-43f0-a6bc-139252d0df9f req-91c326cf-455a-4517-9a30-30461c58c321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3531d45-3bff-4ee2-8e4b-864007259a1f", "tag": "d9231dd0-f5a8-4f6d-9dfd-c88717155b60"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:31:26.684007 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-702d860e-838c-43f0-a6bc-139252d0df9f req-91c326cf-455a-4517-9a30-30461c58c321 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:26.684549 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-702d860e-838c-43f0-a6bc-139252d0df9f req-91c326cf-455a-4517-9a30-30461c58c321 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:26.698794 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-702d860e-838c-43f0-a6bc-139252d0df9f req-91c326cf-455a-4517-9a30-30461c58c321 service nova] Creating event network-changed:d9231dd0-f5a8-4f6d-9dfd-c88717155b60 for instance b3531d45-3bff-4ee2-8e4b-864007259a1f on hv-cinder-79733 Jul 04 06:31:26.704584 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-702d860e-838c-43f0-a6bc-139252d0df9f req-91c326cf-455a-4517-9a30-30461c58c321 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036236 Jul 04 06:31:26.705960 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1100/2218] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:31:27.806418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7f8ab6a3-d035-43b3-a841-2f67bb786ea7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1624517182"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:31:27.806979 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7f8ab6a3-d035-43b3-a841-2f67bb786ea7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:27.813680 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f8ab6a3-d035-43b3-a841-2f67bb786ea7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:27.814124 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f8ab6a3-d035-43b3-a841-2f67bb786ea7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:27.814881 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f8ab6a3-d035-43b3-a841-2f67bb786ea7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:27.815416 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f8ab6a3-d035-43b3-a841-2f67bb786ea7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:27.945072 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.network.security_group_api [None req-7f8ab6a3-d035-43b3-a841-2f67bb786ea7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Adding security group 19ae66bd-d586-4d18-877e-e026b99dac3a to port d9231dd0-f5a8-4f6d-9dfd-c88717155b60 Jul 04 06:31:28.304720 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7f8ab6a3-d035-43b3-a841-2f67bb786ea7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "POST /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/action" status: 202 len: 0 microversion: 2.1 time: 0.502612 Jul 04 06:31:28.310239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1119/2219] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 06:31:27 2022] POST /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:31:28.315224 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0d44a36e-d51d-4981-ad33-bc002709e3b4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:28.315955 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0d44a36e-d51d-4981-ad33-bc002709e3b4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:28.323993 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d44a36e-d51d-4981-ad33-bc002709e3b4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:28.324447 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d44a36e-d51d-4981-ad33-bc002709e3b4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:28.328914 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d44a36e-d51d-4981-ad33-bc002709e3b4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:28.329401 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d44a36e-d51d-4981-ad33-bc002709e3b4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:28.492104 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0d44a36e-d51d-4981-ad33-bc002709e3b4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:28.501382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0d44a36e-d51d-4981-ad33-bc002709e3b4 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1757 microversion: 2.1 time: 0.190820 Jul 04 06:31:28.511728 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1101/2220] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:28 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:28.719979 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-872fb76a-9246-4659-bb07-4f3e3e5e8038 req-4d74469c-c26a-4b46-806a-3ad385497363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3531d45-3bff-4ee2-8e4b-864007259a1f", "tag": "d9231dd0-f5a8-4f6d-9dfd-c88717155b60"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:31:28.728981 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-872fb76a-9246-4659-bb07-4f3e3e5e8038 req-4d74469c-c26a-4b46-806a-3ad385497363 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:28.729422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-872fb76a-9246-4659-bb07-4f3e3e5e8038 req-4d74469c-c26a-4b46-806a-3ad385497363 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:28.740899 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-872fb76a-9246-4659-bb07-4f3e3e5e8038 req-4d74469c-c26a-4b46-806a-3ad385497363 service nova] Creating event network-changed:d9231dd0-f5a8-4f6d-9dfd-c88717155b60 for instance b3531d45-3bff-4ee2-8e4b-864007259a1f on hv-cinder-79733 Jul 04 06:31:28.746194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-872fb76a-9246-4659-bb07-4f3e3e5e8038 req-4d74469c-c26a-4b46-806a-3ad385497363 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029943 Jul 04 06:31:28.747087 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1120/2221] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:31:51.062235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-690b2ca1-3100-40fe-9484-882d827c914f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:31:51.063643 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-690b2ca1-3100-40fe-9484-882d827c914f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:51.067560 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=5 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:51.068487 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:51.076570 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-690b2ca1-3100-40fe-9484-882d827c914f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:51.077018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-690b2ca1-3100-40fe-9484-882d827c914f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:51.077778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-690b2ca1-3100-40fe-9484-882d827c914f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:51.078210 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-690b2ca1-3100-40fe-9484-882d827c914f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:51.159664 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-690b2ca1-3100-40fe-9484-882d827c914f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "POST /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/action" status: 202 len: 0 microversion: 2.1 time: 0.103540 Jul 04 06:31:51.162113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1102/2222] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 06:31:51 2022] POST /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:31:51.168235 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=5 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:51.169100 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=66 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:31:51.173454 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9086ad12-646a-4702-be1d-4119cc6b2a34 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:51.173938 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9086ad12-646a-4702-be1d-4119cc6b2a34 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:51.181148 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9086ad12-646a-4702-be1d-4119cc6b2a34 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:51.181630 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9086ad12-646a-4702-be1d-4119cc6b2a34 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:51.182383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9086ad12-646a-4702-be1d-4119cc6b2a34 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:51.182811 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9086ad12-646a-4702-be1d-4119cc6b2a34 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:51.422165 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9086ad12-646a-4702-be1d-4119cc6b2a34 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:51.430585 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9086ad12-646a-4702-be1d-4119cc6b2a34 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1749 microversion: 2.1 time: 0.264802 Jul 04 06:31:51.431142 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1121/2223] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:51 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1749 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:52.453022 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-327e947f-a396-43ef-a63c-b6cfa37dff24 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:52.453719 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-327e947f-a396-43ef-a63c-b6cfa37dff24 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:52.460103 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-327e947f-a396-43ef-a63c-b6cfa37dff24 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:52.460552 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-327e947f-a396-43ef-a63c-b6cfa37dff24 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:52.461307 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-327e947f-a396-43ef-a63c-b6cfa37dff24 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:52.461741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-327e947f-a396-43ef-a63c-b6cfa37dff24 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:52.604389 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-327e947f-a396-43ef-a63c-b6cfa37dff24 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:52.612834 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-327e947f-a396-43ef-a63c-b6cfa37dff24 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1754 microversion: 2.1 time: 0.166507 Jul 04 06:31:52.613405 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1103/2224] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:52 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:53.635351 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e458fba2-d1e2-4b62-bae5-74fa8bc4462f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:53.636351 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e458fba2-d1e2-4b62-bae5-74fa8bc4462f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:53.647465 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e458fba2-d1e2-4b62-bae5-74fa8bc4462f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:53.648204 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e458fba2-d1e2-4b62-bae5-74fa8bc4462f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:53.649440 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e458fba2-d1e2-4b62-bae5-74fa8bc4462f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:53.650145 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e458fba2-d1e2-4b62-bae5-74fa8bc4462f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:53.806767 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e458fba2-d1e2-4b62-bae5-74fa8bc4462f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:53.816264 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e458fba2-d1e2-4b62-bae5-74fa8bc4462f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1754 microversion: 2.1 time: 0.187580 Jul 04 06:31:53.816831 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1122/2225] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:53 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:54.838022 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-687286a9-5874-47b5-bba4-8b623d005bcf tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:54.839057 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-687286a9-5874-47b5-bba4-8b623d005bcf tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:54.849957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-687286a9-5874-47b5-bba4-8b623d005bcf tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:54.850701 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-687286a9-5874-47b5-bba4-8b623d005bcf tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:54.852011 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-687286a9-5874-47b5-bba4-8b623d005bcf tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:54.852730 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-687286a9-5874-47b5-bba4-8b623d005bcf tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:55.006454 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-687286a9-5874-47b5-bba4-8b623d005bcf tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:55.018212 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-687286a9-5874-47b5-bba4-8b623d005bcf tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1754 microversion: 2.1 time: 0.186790 Jul 04 06:31:55.018878 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1104/2226] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:54 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:56.040178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6af550f8-cd8f-43cf-b0ae-897e42990c44 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:56.040770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6af550f8-cd8f-43cf-b0ae-897e42990c44 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:56.047422 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6af550f8-cd8f-43cf-b0ae-897e42990c44 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:56.047878 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6af550f8-cd8f-43cf-b0ae-897e42990c44 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:56.048640 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6af550f8-cd8f-43cf-b0ae-897e42990c44 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:56.049076 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6af550f8-cd8f-43cf-b0ae-897e42990c44 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:56.207639 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6af550f8-cd8f-43cf-b0ae-897e42990c44 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:56.215867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6af550f8-cd8f-43cf-b0ae-897e42990c44 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1754 microversion: 2.1 time: 0.179630 Jul 04 06:31:56.216447 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1123/2227] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:56 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:57.242200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-39b49c68-bfa1-4bdb-ad36-653e2da27443 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:57.243203 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-39b49c68-bfa1-4bdb-ad36-653e2da27443 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:57.252140 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39b49c68-bfa1-4bdb-ad36-653e2da27443 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:57.252582 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39b49c68-bfa1-4bdb-ad36-653e2da27443 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:57.253338 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39b49c68-bfa1-4bdb-ad36-653e2da27443 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:57.253741 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39b49c68-bfa1-4bdb-ad36-653e2da27443 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:57.659655 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-39b49c68-bfa1-4bdb-ad36-653e2da27443 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:57.667909 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-39b49c68-bfa1-4bdb-ad36-653e2da27443 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1754 microversion: 2.1 time: 0.436903 Jul 04 06:31:57.668507 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1105/2228] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:57 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1754 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:58.693706 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-69cd34a2-1c89-419d-a180-8b82a942b8c1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:58.694621 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-69cd34a2-1c89-419d-a180-8b82a942b8c1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:58.703699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69cd34a2-1c89-419d-a180-8b82a942b8c1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:58.704147 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69cd34a2-1c89-419d-a180-8b82a942b8c1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:58.704890 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69cd34a2-1c89-419d-a180-8b82a942b8c1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:58.705315 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69cd34a2-1c89-419d-a180-8b82a942b8c1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:58.851655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-69cd34a2-1c89-419d-a180-8b82a942b8c1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:31:58.863194 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-69cd34a2-1c89-419d-a180-8b82a942b8c1 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1754 microversion: 2.1 time: 0.176037 Jul 04 06:31:58.864008 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1124/2229] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:58 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:31:59.884668 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c740892c-25a6-479f-93ef-4a52a7fe82b2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:31:59.885577 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c740892c-25a6-479f-93ef-4a52a7fe82b2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:31:59.893412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c740892c-25a6-479f-93ef-4a52a7fe82b2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:59.893869 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c740892c-25a6-479f-93ef-4a52a7fe82b2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:31:59.894631 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c740892c-25a6-479f-93ef-4a52a7fe82b2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:31:59.895081 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c740892c-25a6-479f-93ef-4a52a7fe82b2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:00.069497 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c740892c-25a6-479f-93ef-4a52a7fe82b2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:32:00.078004 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c740892c-25a6-479f-93ef-4a52a7fe82b2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1754 microversion: 2.1 time: 0.199990 Jul 04 06:32:00.078539 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1106/2230] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:31:59 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1754 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:32:01.104009 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-13066a96-4604-4131-9968-586da9268dc7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:01.105000 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-13066a96-4604-4131-9968-586da9268dc7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:01.116137 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13066a96-4604-4131-9968-586da9268dc7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:01.116901 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13066a96-4604-4131-9968-586da9268dc7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:01.118138 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13066a96-4604-4131-9968-586da9268dc7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:01.118855 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13066a96-4604-4131-9968-586da9268dc7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:01.267867 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-13066a96-4604-4131-9968-586da9268dc7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:32:01.276580 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-13066a96-4604-4131-9968-586da9268dc7 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1754 microversion: 2.1 time: 0.179150 Jul 04 06:32:01.277153 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1125/2231] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:32:01 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:32:02.295528 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-97adb8f3-3392-4efc-a1bc-89467993980f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:02.296202 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-97adb8f3-3392-4efc-a1bc-89467993980f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:02.304646 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97adb8f3-3392-4efc-a1bc-89467993980f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:02.305176 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97adb8f3-3392-4efc-a1bc-89467993980f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:02.306054 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97adb8f3-3392-4efc-a1bc-89467993980f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:02.306572 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97adb8f3-3392-4efc-a1bc-89467993980f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:02.458484 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-97adb8f3-3392-4efc-a1bc-89467993980f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:32:02.466778 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-97adb8f3-3392-4efc-a1bc-89467993980f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1754 microversion: 2.1 time: 0.176047 Jul 04 06:32:02.467501 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1107/2232] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:32:02 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:32:03.488480 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2797dc55-2372-459e-879d-1309ecaffd83 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:03.489485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2797dc55-2372-459e-879d-1309ecaffd83 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:03.499560 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2797dc55-2372-459e-879d-1309ecaffd83 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:03.500012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2797dc55-2372-459e-879d-1309ecaffd83 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:03.500821 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2797dc55-2372-459e-879d-1309ecaffd83 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:03.501257 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2797dc55-2372-459e-879d-1309ecaffd83 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:03.644267 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2797dc55-2372-459e-879d-1309ecaffd83 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:32:03.652552 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2797dc55-2372-459e-879d-1309ecaffd83 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1757 microversion: 2.1 time: 0.170750 Jul 04 06:32:03.653101 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1126/2233] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:32:03 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:32:35.928239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a533ff15-a3e0-4b0b-94ef-1f1aa7faf9a0 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1624517182"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:32:35.929355 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a533ff15-a3e0-4b0b-94ef-1f1aa7faf9a0 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:35.931863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=12 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:32:35.932588 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:32:35.939577 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a533ff15-a3e0-4b0b-94ef-1f1aa7faf9a0 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:35.940056 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a533ff15-a3e0-4b0b-94ef-1f1aa7faf9a0 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:35.940896 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a533ff15-a3e0-4b0b-94ef-1f1aa7faf9a0 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:35.941399 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a533ff15-a3e0-4b0b-94ef-1f1aa7faf9a0 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:36.073789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.network.security_group_api [None req-a533ff15-a3e0-4b0b-94ef-1f1aa7faf9a0 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Removing security group 19ae66bd-d586-4d18-877e-e026b99dac3a from port d9231dd0-f5a8-4f6d-9dfd-c88717155b60 Jul 04 06:32:36.425235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a533ff15-a3e0-4b0b-94ef-1f1aa7faf9a0 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "POST /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/action" status: 202 len: 0 microversion: 2.1 time: 0.502568 Jul 04 06:32:36.428873 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1108/2234] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 06:32:35 2022] POST /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:32:36.439567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-a8e9a584-914d-476f-8f00-fbe0a5d7dd4f req-74b4fd3b-7525-4719-ba77-3eab95ecb07b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3531d45-3bff-4ee2-8e4b-864007259a1f", "tag": "d9231dd0-f5a8-4f6d-9dfd-c88717155b60"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:32:36.457331 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=12 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:32:36.458415 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=36 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:32:36.461299 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a8e9a584-914d-476f-8f00-fbe0a5d7dd4f req-74b4fd3b-7525-4719-ba77-3eab95ecb07b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:36.462364 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a8e9a584-914d-476f-8f00-fbe0a5d7dd4f req-74b4fd3b-7525-4719-ba77-3eab95ecb07b service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:36.484730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-a8e9a584-914d-476f-8f00-fbe0a5d7dd4f req-74b4fd3b-7525-4719-ba77-3eab95ecb07b service nova] Creating event network-changed:d9231dd0-f5a8-4f6d-9dfd-c88717155b60 for instance b3531d45-3bff-4ee2-8e4b-864007259a1f on hv-cinder-79733 Jul 04 06:32:36.492770 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-a8e9a584-914d-476f-8f00-fbe0a5d7dd4f req-74b4fd3b-7525-4719-ba77-3eab95ecb07b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058844 Jul 04 06:32:36.494820 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1127/2235] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:32:37.677144 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8b2083b0-54e8-409f-95c5-e4f996c7272c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:37.677649 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8b2083b0-54e8-409f-95c5-e4f996c7272c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:37.683931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b2083b0-54e8-409f-95c5-e4f996c7272c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:37.684379 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b2083b0-54e8-409f-95c5-e4f996c7272c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:37.685138 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b2083b0-54e8-409f-95c5-e4f996c7272c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:37.685568 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b2083b0-54e8-409f-95c5-e4f996c7272c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:37.766130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-8b2083b0-54e8-409f-95c5-e4f996c7272c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lazy-loading 'services' on Instance uuid b3531d45-3bff-4ee2-8e4b-864007259a1f {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:32:37.839844 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8b2083b0-54e8-409f-95c5-e4f996c7272c tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/os-volume_attachments/8e334377-d37a-4f67-86f5-60b952343408" status: 202 len: 0 microversion: 2.1 time: 0.167387 Jul 04 06:32:37.840460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1109/2236] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jul 4 06:32:37 2022] DELETE /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/os-volume_attachments/8e334377-d37a-4f67-86f5-60b952343408 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:32:37.850200 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-45a60347-0915-4e71-9010-917ed610c3c3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:37.851234 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-45a60347-0915-4e71-9010-917ed610c3c3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:37.858355 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45a60347-0915-4e71-9010-917ed610c3c3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:37.859034 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45a60347-0915-4e71-9010-917ed610c3c3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:37.859888 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45a60347-0915-4e71-9010-917ed610c3c3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:37.860316 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45a60347-0915-4e71-9010-917ed610c3c3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:37.891613 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-45a60347-0915-4e71-9010-917ed610c3c3 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Jul 04 06:32:37.892369 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1128/2237] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:32:37 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 06:32:38.508813 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-73aa58a1-2018-41b7-bb6d-476f2f4fbf2a req-6df7b50f-cef0-4713-8c46-eb09ff3a3c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3531d45-3bff-4ee2-8e4b-864007259a1f", "tag": "d9231dd0-f5a8-4f6d-9dfd-c88717155b60"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:32:38.521061 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-73aa58a1-2018-41b7-bb6d-476f2f4fbf2a req-6df7b50f-cef0-4713-8c46-eb09ff3a3c01 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:38.521425 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-73aa58a1-2018-41b7-bb6d-476f2f4fbf2a req-6df7b50f-cef0-4713-8c46-eb09ff3a3c01 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:38.532952 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-73aa58a1-2018-41b7-bb6d-476f2f4fbf2a req-6df7b50f-cef0-4713-8c46-eb09ff3a3c01 service nova] Creating event network-changed:d9231dd0-f5a8-4f6d-9dfd-c88717155b60 for instance b3531d45-3bff-4ee2-8e4b-864007259a1f on hv-cinder-79733 Jul 04 06:32:38.537931 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-73aa58a1-2018-41b7-bb6d-476f2f4fbf2a req-6df7b50f-cef0-4713-8c46-eb09ff3a3c01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033152 Jul 04 06:32:38.538906 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1110/2238] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:32:38.904060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-510c9031-f128-4b6a-b5d3-ce3cf42153a2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:38.904995 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-510c9031-f128-4b6a-b5d3-ce3cf42153a2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:38.911963 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-510c9031-f128-4b6a-b5d3-ce3cf42153a2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:38.912414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-510c9031-f128-4b6a-b5d3-ce3cf42153a2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:38.913182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-510c9031-f128-4b6a-b5d3-ce3cf42153a2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:38.913618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-510c9031-f128-4b6a-b5d3-ce3cf42153a2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:38.942625 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-510c9031-f128-4b6a-b5d3-ce3cf42153a2 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042579 Jul 04 06:32:38.943202 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1129/2239] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jul 4 06:32:38 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 06:32:38.954287 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-221d32fb-1a60-4ab4-8ef8-d0eec0ef7a76 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:38.955217 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-221d32fb-1a60-4ab4-8ef8-d0eec0ef7a76 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:38.961636 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-221d32fb-1a60-4ab4-8ef8-d0eec0ef7a76 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:38.962163 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-221d32fb-1a60-4ab4-8ef8-d0eec0ef7a76 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:38.962933 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-221d32fb-1a60-4ab4-8ef8-d0eec0ef7a76 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:38.963400 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-221d32fb-1a60-4ab4-8ef8-d0eec0ef7a76 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:39.041521 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-221d32fb-1a60-4ab4-8ef8-d0eec0ef7a76 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] HTTP exception thrown: Instance b3531d45-3bff-4ee2-8e4b-864007259a1f is not attached to volume 8e334377-d37a-4f67-86f5-60b952343408 Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-221d32fb-1a60-4ab4-8ef8-d0eec0ef7a76 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Request method failure captured: Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/os-volume_attachments/8e334377-d37a-4f67-86f5-60b952343408 HTTP/1.1 Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwokHYyh41skhL8b6RhrVaOhGOpHlVQIPdJJ9WmHOgejhqCaZCNSxJoLAENIh5HZb97TC2q9wK-8j5Y9O0IdXGEm0wABkF08xib9GkWC3mH8cY4EzScTOsMhHjJ4ccj8jGbVds2gbmM9nI6O1bp5pYdkmBLB9m-nc3wEYLpck6xPaMjU Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 764c6dcba64244dba2aff169c181ccea Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestMinimumBasicScenario-2075713003 Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:32:39.043884 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:32:39.045199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/764c6dcba64244dba2aff169c181ccea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/764c6dcba64244dba2aff169c181ccea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/764c6dcba64244dba2aff169c181ccea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_764c6dcba64244dba2aff169c181ccea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:32:39.045199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestMinimumBasicScenario-2075713003 Jul 04 06:32:39.045199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 764c6dcba64244dba2aff169c181ccea Jul 04 06:32:39.045199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2075713003 Jul 04 06:32:39.045199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-TestMinimumBasicScenario-2075713003-project Jul 04 06:32:39.045199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:32:39.045199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:32:39.045199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 82e1f29c9cda427cac832f4481fd0b26 Jul 04 06:32:39.045199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestMinimumBasicScenario-2075713003-project Jul 04 06:32:39.045199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:32:39.045199 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance b3531d45-3bff-4ee2-8e4b-864007259a1f is not attached to volume 8e334377-d37a-4f67-86f5-60b952343408 Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'server_id': 'b3531d45-3bff-4ee2-8e4b-864007259a1f', 'id': '8e334377-d37a-4f67-86f5-60b952343408'} Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8e334377-d37a-4f67-86f5-60b952343408. Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:32:39.045901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3531d45-3bff-4ee2-8e4b-864007259a1f is not attached to volume 8e334377-d37a-4f67-86f5-60b952343408 Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3531d45-3bff-4ee2-8e4b-864007259a1f is not attached to volume 8e334377-d37a-4f67-86f5-60b952343408 Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:32:39.047052 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-221d32fb-1a60-4ab4-8ef8-d0eec0ef7a76 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Returning 404 to user: Instance b3531d45-3bff-4ee2-8e4b-864007259a1f is not attached to volume 8e334377-d37a-4f67-86f5-60b952343408 {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:32:39.047957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-221d32fb-1a60-4ab4-8ef8-d0eec0ef7a76 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/os-volume_attachments/8e334377-d37a-4f67-86f5-60b952343408" status: 404 len: 154 microversion: 2.1 time: 0.095873 Jul 04 06:32:39.047957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1111/2240] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jul 4 06:32:38 2022] DELETE /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f/os-volume_attachments/8e334377-d37a-4f67-86f5-60b952343408 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:32:40.186618 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-89d8ad9b-afad-4f54-83c6-8ef0c77c5a80 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:40.187119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-89d8ad9b-afad-4f54-83c6-8ef0c77c5a80 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:40.193926 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89d8ad9b-afad-4f54-83c6-8ef0c77c5a80 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:40.194365 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89d8ad9b-afad-4f54-83c6-8ef0c77c5a80 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:40.195128 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89d8ad9b-afad-4f54-83c6-8ef0c77c5a80 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:40.195620 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89d8ad9b-afad-4f54-83c6-8ef0c77c5a80 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:40.220937 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-89d8ad9b-afad-4f54-83c6-8ef0c77c5a80 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:32:40.306408 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-89d8ad9b-afad-4f54-83c6-8ef0c77c5a80 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 204 len: 0 microversion: 2.1 time: 0.123752 Jul 04 06:32:40.307111 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1130/2241] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:32:40 2022] DELETE /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 06:32:40.315353 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-abc6386f-3244-4fe1-9633-5182bd3a5042 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:40.315963 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-abc6386f-3244-4fe1-9633-5182bd3a5042 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:40.323130 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abc6386f-3244-4fe1-9633-5182bd3a5042 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:40.323604 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abc6386f-3244-4fe1-9633-5182bd3a5042 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:40.324369 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abc6386f-3244-4fe1-9633-5182bd3a5042 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:40.324863 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abc6386f-3244-4fe1-9633-5182bd3a5042 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:40.472191 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-abc6386f-3244-4fe1-9633-5182bd3a5042 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:32:40.484683 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-abc6386f-3244-4fe1-9633-5182bd3a5042 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1552 microversion: 2.1 time: 0.172867 Jul 04 06:32:40.485580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1112/2242] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:32:40 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:32:41.507361 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-10212c01-2eb9-44e3-a173-527eec93cca5 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:41.508211 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-10212c01-2eb9-44e3-a173-527eec93cca5 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:41.515292 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10212c01-2eb9-44e3-a173-527eec93cca5 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:41.515729 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10212c01-2eb9-44e3-a173-527eec93cca5 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:41.516522 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10212c01-2eb9-44e3-a173-527eec93cca5 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:41.516982 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10212c01-2eb9-44e3-a173-527eec93cca5 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:41.680037 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10212c01-2eb9-44e3-a173-527eec93cca5 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:32:41.687916 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-10212c01-2eb9-44e3-a173-527eec93cca5 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1552 microversion: 2.1 time: 0.186145 Jul 04 06:32:41.688489 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1131/2243] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:32:41 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:32:42.460173 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-e3ba8cef-8725-49d4-9dbd-d205b9555c67 req-5e24cd38-26c0-4dc6-8281-a648f37f1911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3531d45-3bff-4ee2-8e4b-864007259a1f", "name": "network-vif-deleted", "tag": "d9231dd0-f5a8-4f6d-9dfd-c88717155b60"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:32:42.470284 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-e3ba8cef-8725-49d4-9dbd-d205b9555c67 req-5e24cd38-26c0-4dc6-8281-a648f37f1911 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:42.471226 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-e3ba8cef-8725-49d4-9dbd-d205b9555c67 req-5e24cd38-26c0-4dc6-8281-a648f37f1911 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:42.483621 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-e3ba8cef-8725-49d4-9dbd-d205b9555c67 req-5e24cd38-26c0-4dc6-8281-a648f37f1911 service nova] Creating event network-vif-deleted:d9231dd0-f5a8-4f6d-9dfd-c88717155b60 for instance b3531d45-3bff-4ee2-8e4b-864007259a1f on hv-cinder-79733 Jul 04 06:32:42.488803 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-e3ba8cef-8725-49d4-9dbd-d205b9555c67 req-5e24cd38-26c0-4dc6-8281-a648f37f1911 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033937 Jul 04 06:32:42.489412 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1113/2244] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:32:42.707721 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dee839a5-c257-40ad-8c5a-02fbe6c73dfa tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:42.708448 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dee839a5-c257-40ad-8c5a-02fbe6c73dfa tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:42.715904 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee839a5-c257-40ad-8c5a-02fbe6c73dfa tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:42.716430 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee839a5-c257-40ad-8c5a-02fbe6c73dfa tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:42.717230 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee839a5-c257-40ad-8c5a-02fbe6c73dfa tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:42.717670 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee839a5-c257-40ad-8c5a-02fbe6c73dfa tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:42.751091 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee839a5-c257-40ad-8c5a-02fbe6c73dfa tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:42.751567 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dee839a5-c257-40ad-8c5a-02fbe6c73dfa tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:42.752026 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-dee839a5-c257-40ad-8c5a-02fbe6c73dfa tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lazy-loading 'fault' on Instance uuid b3531d45-3bff-4ee2-8e4b-864007259a1f {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:32:42.801526 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dee839a5-c257-40ad-8c5a-02fbe6c73dfa tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e1f29c9cda427cac832f4481fd0b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764c6dcba64244dba2aff169c181ccea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:32:42.810159 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dee839a5-c257-40ad-8c5a-02fbe6c73dfa tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 200 len: 1347 microversion: 2.1 time: 0.107841 Jul 04 06:32:42.810975 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1132/2245] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:32:42 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 1347 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:32:43.833200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11c4f0a7-cdd4-4b81-b1b9-f22fbfa70103 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:43.834226 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-11c4f0a7-cdd4-4b81-b1b9-f22fbfa70103 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] [instance: b3531d45-3bff-4ee2-8e4b-864007259a1f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:32:43.844830 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11c4f0a7-cdd4-4b81-b1b9-f22fbfa70103 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:43.845563 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11c4f0a7-cdd4-4b81-b1b9-f22fbfa70103 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:43.846822 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11c4f0a7-cdd4-4b81-b1b9-f22fbfa70103 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:32:43.847594 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11c4f0a7-cdd4-4b81-b1b9-f22fbfa70103 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:32:43.863360 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-11c4f0a7-cdd4-4b81-b1b9-f22fbfa70103 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] HTTP exception thrown: Instance b3531d45-3bff-4ee2-8e4b-864007259a1f could not be found. Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11c4f0a7-cdd4-4b81-b1b9-f22fbfa70103 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Request method failure captured: Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f HTTP/1.1 Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept: application/json Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Connection: close Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Host: 10.222.0.42 Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABiwokHYyh41skhL8b6RhrVaOhGOpHlVQIPdJJ9WmHOgejhqCaZCNSxJoLAENIh5HZb97TC2q9wK-8j5Y9O0IdXGEm0wABkF08xib9GkWC3mH8cY4EzScTOsMhHjJ4ccj8jGbVds2gbmM9nI6O1bp5pYdkmBLB9m-nc3wEYLpck6xPaMjU Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Id: 764c6dcba64244dba2aff169c181ccea Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestMinimumBasicScenario-2075713003 Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Role: reader,member Jul 04 06:32:43.864967 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Roles: reader,member Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/764c6dcba64244dba2aff169c181ccea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/764c6dcba64244dba2aff169c181ccea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/764c6dcba64244dba2aff169c181ccea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_764c6dcba64244dba2aff169c181ccea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestMinimumBasicScenario-2075713003 Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 764c6dcba64244dba2aff169c181ccea Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2075713003 Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User: tempest-TestMinimumBasicScenario-2075713003-project Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Id: 82e1f29c9cda427cac832f4481fd0b26 Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestMinimumBasicScenario-2075713003-project Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: method: > Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: exception: Instance b3531d45-3bff-4ee2-8e4b-864007259a1f could not be found. Jul 04 06:32:43.866390 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: action_args: {'id': 'b3531d45-3bff-4ee2-8e4b-864007259a1f'} Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3531d45-3bff-4ee2-8e4b-864007259a1f could not be found. Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:32:43.867290 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3531d45-3bff-4ee2-8e4b-864007259a1f could not be found. Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3531d45-3bff-4ee2-8e4b-864007259a1f could not be found. Jul 04 06:32:43.868647 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jul 04 06:32:43.869864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11c4f0a7-cdd4-4b81-b1b9-f22fbfa70103 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Returning 404 to user: Instance b3531d45-3bff-4ee2-8e4b-864007259a1f could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:32:43.869864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-11c4f0a7-cdd4-4b81-b1b9-f22fbfa70103 tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f" status: 404 len: 111 microversion: 2.1 time: 0.041245 Jul 04 06:32:43.869864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1114/2246] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:32:43 2022] GET /compute/v2.1/servers/b3531d45-3bff-4ee2-8e4b-864007259a1f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:32:43.875542 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-877b9ab1-b166-403e-a22d-2269b227304f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] Calling method '.version_select at 0x7f204fd7d3a0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:32:43.896327 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-877b9ab1-b166-403e-a22d-2269b227304f tempest-TestMinimumBasicScenario-2075713003 tempest-TestMinimumBasicScenario-2075713003-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-139990029" status: 202 len: 0 microversion: 2.1 time: 0.024952 Jul 04 06:32:43.896922 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1133/2247] 10.222.0.42 () {58 vars in 1268 bytes} [Mon Jul 4 06:32:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-139990029 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:33:20.466678 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-32619d42-00a8-441d-9912-bf809bf2bd0c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:33:20.467345 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-32619d42-00a8-441d-9912-bf809bf2bd0c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:20.469564 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=14 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:33:20.470196 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:33:20.475918 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32619d42-00a8-441d-9912-bf809bf2bd0c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:20.476352 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32619d42-00a8-441d-9912-bf809bf2bd0c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:20.477102 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32619d42-00a8-441d-9912-bf809bf2bd0c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:20.477527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32619d42-00a8-441d-9912-bf809bf2bd0c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:20.501678 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-32619d42-00a8-441d-9912-bf809bf2bd0c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lazy-loading 'flavor' on Instance uuid fbe8d554-ad9e-48f8-909a-a07fd4cc63da {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:33:20.579721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-32619d42-00a8-441d-9912-bf809bf2bd0c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "POST /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da/action" status: 202 len: 0 microversion: 2.1 time: 0.117357 Jul 04 06:33:20.580304 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1115/2248] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 06:33:20 2022] POST /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:33:20.586722 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:33:20.587535 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:33:20.592419 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ef4f17ac-bdd9-469e-8281-4d4de839e5cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:20.592600 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ef4f17ac-bdd9-469e-8281-4d4de839e5cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:20.600055 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef4f17ac-bdd9-469e-8281-4d4de839e5cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:20.600544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef4f17ac-bdd9-469e-8281-4d4de839e5cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:20.601373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef4f17ac-bdd9-469e-8281-4d4de839e5cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:20.601810 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef4f17ac-bdd9-469e-8281-4d4de839e5cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:20.744458 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ef4f17ac-bdd9-469e-8281-4d4de839e5cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:20.752953 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ef4f17ac-bdd9-469e-8281-4d4de839e5cb tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.167960 Jul 04 06:33:20.753529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1134/2249] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:20 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:21.776611 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f38a434-34d4-4659-8b62-474d0f393a7f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:21.777721 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8f38a434-34d4-4659-8b62-474d0f393a7f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:21.788274 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f38a434-34d4-4659-8b62-474d0f393a7f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:21.789022 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f38a434-34d4-4659-8b62-474d0f393a7f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:21.790326 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f38a434-34d4-4659-8b62-474d0f393a7f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:21.791113 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f38a434-34d4-4659-8b62-474d0f393a7f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:21.930899 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8f38a434-34d4-4659-8b62-474d0f393a7f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:21.939066 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8f38a434-34d4-4659-8b62-474d0f393a7f tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.171760 Jul 04 06:33:21.939667 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1116/2250] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:21 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:22.960699 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-62f94200-84cf-4e01-a74a-7b527f18ffd8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:22.962464 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-62f94200-84cf-4e01-a74a-7b527f18ffd8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:22.969827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62f94200-84cf-4e01-a74a-7b527f18ffd8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:22.970279 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62f94200-84cf-4e01-a74a-7b527f18ffd8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:22.971056 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62f94200-84cf-4e01-a74a-7b527f18ffd8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:22.971529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62f94200-84cf-4e01-a74a-7b527f18ffd8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:23.113478 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-62f94200-84cf-4e01-a74a-7b527f18ffd8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:23.121753 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-62f94200-84cf-4e01-a74a-7b527f18ffd8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.167284 Jul 04 06:33:23.122373 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1135/2251] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:22 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:24.143156 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-26038268-4722-4675-8c39-d4ac03991a5c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:24.144417 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-26038268-4722-4675-8c39-d4ac03991a5c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:24.155392 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26038268-4722-4675-8c39-d4ac03991a5c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:24.156142 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26038268-4722-4675-8c39-d4ac03991a5c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:24.157401 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26038268-4722-4675-8c39-d4ac03991a5c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:24.158126 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26038268-4722-4675-8c39-d4ac03991a5c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:24.292478 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-26038268-4722-4675-8c39-d4ac03991a5c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:24.300594 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-26038268-4722-4675-8c39-d4ac03991a5c tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.163868 Jul 04 06:33:24.301158 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1117/2252] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:24 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:25.321927 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e140515d-bc45-4a62-817a-79c2d6cd3227 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:25.322931 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e140515d-bc45-4a62-817a-79c2d6cd3227 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:25.329861 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e140515d-bc45-4a62-817a-79c2d6cd3227 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:25.330300 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e140515d-bc45-4a62-817a-79c2d6cd3227 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:25.331085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e140515d-bc45-4a62-817a-79c2d6cd3227 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:25.331544 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e140515d-bc45-4a62-817a-79c2d6cd3227 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:25.465812 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e140515d-bc45-4a62-817a-79c2d6cd3227 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:25.474177 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e140515d-bc45-4a62-817a-79c2d6cd3227 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.158975 Jul 04 06:33:25.474754 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1136/2253] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:25 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:26.491451 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-77a1d10c-d73b-46cb-97cc-bf66397adc38 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:26.492187 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-77a1d10c-d73b-46cb-97cc-bf66397adc38 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:26.499147 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77a1d10c-d73b-46cb-97cc-bf66397adc38 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:26.499631 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77a1d10c-d73b-46cb-97cc-bf66397adc38 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:26.500399 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77a1d10c-d73b-46cb-97cc-bf66397adc38 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:26.500832 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77a1d10c-d73b-46cb-97cc-bf66397adc38 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:26.639753 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-77a1d10c-d73b-46cb-97cc-bf66397adc38 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:26.647724 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-77a1d10c-d73b-46cb-97cc-bf66397adc38 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.160077 Jul 04 06:33:26.648266 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1118/2254] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:26 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:27.668762 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4adfcdea-10fe-49ac-b05a-6dd929a12fa5 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:27.669352 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4adfcdea-10fe-49ac-b05a-6dd929a12fa5 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:27.676181 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4adfcdea-10fe-49ac-b05a-6dd929a12fa5 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:27.676655 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4adfcdea-10fe-49ac-b05a-6dd929a12fa5 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:27.677406 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4adfcdea-10fe-49ac-b05a-6dd929a12fa5 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:27.677833 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4adfcdea-10fe-49ac-b05a-6dd929a12fa5 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:27.813409 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4adfcdea-10fe-49ac-b05a-6dd929a12fa5 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:27.824834 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4adfcdea-10fe-49ac-b05a-6dd929a12fa5 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.160931 Jul 04 06:33:27.825414 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1137/2255] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:27 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:28.846037 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-03fc45e5-b854-4be0-babd-bbe29b3fbc73 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:28.846865 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-03fc45e5-b854-4be0-babd-bbe29b3fbc73 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:28.857866 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03fc45e5-b854-4be0-babd-bbe29b3fbc73 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:28.858603 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03fc45e5-b854-4be0-babd-bbe29b3fbc73 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:28.859890 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03fc45e5-b854-4be0-babd-bbe29b3fbc73 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:28.860607 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03fc45e5-b854-4be0-babd-bbe29b3fbc73 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:29.013216 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-03fc45e5-b854-4be0-babd-bbe29b3fbc73 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:29.021084 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-03fc45e5-b854-4be0-babd-bbe29b3fbc73 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.181646 Jul 04 06:33:29.021616 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1119/2256] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:28 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:30.042171 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-78560ce5-62c7-41fb-9ce9-499d06db8c8b tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:30.043217 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-78560ce5-62c7-41fb-9ce9-499d06db8c8b tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:30.050085 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78560ce5-62c7-41fb-9ce9-499d06db8c8b tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:30.050533 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78560ce5-62c7-41fb-9ce9-499d06db8c8b tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:30.051338 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78560ce5-62c7-41fb-9ce9-499d06db8c8b tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:30.051852 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78560ce5-62c7-41fb-9ce9-499d06db8c8b tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:30.198904 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-78560ce5-62c7-41fb-9ce9-499d06db8c8b tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:30.210119 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-78560ce5-62c7-41fb-9ce9-499d06db8c8b tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.174515 Jul 04 06:33:30.210693 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1138/2257] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:30 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:31.227540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-328cc8c9-eeba-4e79-b2ae-f436d3a6fd27 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:31.228116 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-328cc8c9-eeba-4e79-b2ae-f436d3a6fd27 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:31.234942 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-328cc8c9-eeba-4e79-b2ae-f436d3a6fd27 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:31.235419 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-328cc8c9-eeba-4e79-b2ae-f436d3a6fd27 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:31.236154 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-328cc8c9-eeba-4e79-b2ae-f436d3a6fd27 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:31.236580 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-328cc8c9-eeba-4e79-b2ae-f436d3a6fd27 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:31.371962 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-328cc8c9-eeba-4e79-b2ae-f436d3a6fd27 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:31.383416 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-328cc8c9-eeba-4e79-b2ae-f436d3a6fd27 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.159698 Jul 04 06:33:31.384071 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1120/2258] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:31 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:32.404957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c287f629-179b-490d-92af-ed7d565557ab tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:32.405566 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c287f629-179b-490d-92af-ed7d565557ab tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:32.412476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c287f629-179b-490d-92af-ed7d565557ab tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:32.412915 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c287f629-179b-490d-92af-ed7d565557ab tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:32.413665 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c287f629-179b-490d-92af-ed7d565557ab tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:32.414089 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c287f629-179b-490d-92af-ed7d565557ab tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:32.563843 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c287f629-179b-490d-92af-ed7d565557ab tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:32.574773 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c287f629-179b-490d-92af-ed7d565557ab tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.175362 Jul 04 06:33:32.575486 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1139/2259] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:32 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:33.600894 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1bc1600-9e0b-431f-9bd8-3d8a348d5af2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:33.601937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a1bc1600-9e0b-431f-9bd8-3d8a348d5af2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:33.610494 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1bc1600-9e0b-431f-9bd8-3d8a348d5af2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:33.610948 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1bc1600-9e0b-431f-9bd8-3d8a348d5af2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:33.611737 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1bc1600-9e0b-431f-9bd8-3d8a348d5af2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:33.612178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1bc1600-9e0b-431f-9bd8-3d8a348d5af2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:33.929393 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a1bc1600-9e0b-431f-9bd8-3d8a348d5af2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:33.937409 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a1bc1600-9e0b-431f-9bd8-3d8a348d5af2 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1510 microversion: 2.1 time: 0.343115 Jul 04 06:33:33.937987 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1121/2260] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:33 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1510 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:33.958280 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-47bdfbbe-b2cc-4d6e-8565-91cee47b8b0a tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:33:33.959191 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-47bdfbbe-b2cc-4d6e-8565-91cee47b8b0a tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:33.967499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47bdfbbe-b2cc-4d6e-8565-91cee47b8b0a tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:33.968201 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47bdfbbe-b2cc-4d6e-8565-91cee47b8b0a tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:33.969437 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47bdfbbe-b2cc-4d6e-8565-91cee47b8b0a tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:33.970178 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-47bdfbbe-b2cc-4d6e-8565-91cee47b8b0a tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:34.068499 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR oslo.messaging._drivers.impl_rabbit [None req-47bdfbbe-b2cc-4d6e-8565-91cee47b8b0a tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [ceb68800-ff1f-4213-bff8-aa08f68a5a52] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 04 06:33:35.077210 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [None req-47bdfbbe-b2cc-4d6e-8565-91cee47b8b0a tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [ceb68800-ff1f-4213-bff8-aa08f68a5a52] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39052. Jul 04 06:33:35.081383 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-47bdfbbe-b2cc-4d6e-8565-91cee47b8b0a tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "POST /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da/action" status: 202 len: 0 microversion: 2.1 time: 1.131660 Jul 04 06:33:35.082012 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1140/2261] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 4 06:33:33 2022] POST /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da/action => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:33:35.090217 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-563ca2d2-bb46-40c4-98f8-45f7ea360d6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:35.091020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-563ca2d2-bb46-40c4-98f8-45f7ea360d6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:35.097864 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-563ca2d2-bb46-40c4-98f8-45f7ea360d6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:35.098316 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-563ca2d2-bb46-40c4-98f8-45f7ea360d6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:35.099079 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-563ca2d2-bb46-40c4-98f8-45f7ea360d6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:35.099540 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-563ca2d2-bb46-40c4-98f8-45f7ea360d6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:35.230972 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-563ca2d2-bb46-40c4-98f8-45f7ea360d6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:35.238593 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-563ca2d2-bb46-40c4-98f8-45f7ea360d6d tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1518 microversion: 2.1 time: 0.152325 Jul 04 06:33:35.239139 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1122/2262] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:35 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:36.261529 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c4fdeacf-a10c-48e3-9749-5a3c35189666 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:36.262485 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c4fdeacf-a10c-48e3-9749-5a3c35189666 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:36.273763 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4fdeacf-a10c-48e3-9749-5a3c35189666 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:36.274518 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4fdeacf-a10c-48e3-9749-5a3c35189666 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:36.275838 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4fdeacf-a10c-48e3-9749-5a3c35189666 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:36.276558 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4fdeacf-a10c-48e3-9749-5a3c35189666 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:36.412641 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c4fdeacf-a10c-48e3-9749-5a3c35189666 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:36.423418 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c4fdeacf-a10c-48e3-9749-5a3c35189666 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1520 microversion: 2.1 time: 0.168917 Jul 04 06:33:36.424240 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1141/2263] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:36 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:37.441901 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-252651d9-8d70-4707-b0fe-0622da9059ed tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:37.442517 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-252651d9-8d70-4707-b0fe-0622da9059ed tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:37.449301 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-252651d9-8d70-4707-b0fe-0622da9059ed tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:37.449749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-252651d9-8d70-4707-b0fe-0622da9059ed tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:37.450510 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-252651d9-8d70-4707-b0fe-0622da9059ed tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:37.450934 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-252651d9-8d70-4707-b0fe-0622da9059ed tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:37.587178 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-252651d9-8d70-4707-b0fe-0622da9059ed tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:37.597502 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-252651d9-8d70-4707-b0fe-0622da9059ed tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1576 microversion: 2.1 time: 0.159157 Jul 04 06:33:37.598229 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1123/2264] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:37 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:37.764295 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-9b530cfa-7e47-492e-b87a-722d28dd00fe req-cff35994-f07d-422a-b57c-13b5df98782d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe8d554-ad9e-48f8-909a-a07fd4cc63da", "name": "network-vif-unplugged", "status": "completed", "tag": "97e1d096-0047-4462-b327-16383878a1c0"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:33:37.773094 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9b530cfa-7e47-492e-b87a-722d28dd00fe req-cff35994-f07d-422a-b57c-13b5df98782d service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:37.773374 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9b530cfa-7e47-492e-b87a-722d28dd00fe req-cff35994-f07d-422a-b57c-13b5df98782d service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:37.784893 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-9b530cfa-7e47-492e-b87a-722d28dd00fe req-cff35994-f07d-422a-b57c-13b5df98782d service nova] Creating event network-vif-unplugged:97e1d096-0047-4462-b327-16383878a1c0 for instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da on hv-cinder-79733 Jul 04 06:33:37.789980 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-9b530cfa-7e47-492e-b87a-722d28dd00fe req-cff35994-f07d-422a-b57c-13b5df98782d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029426 Jul 04 06:33:37.790591 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1142/2265] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:33:38.623480 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8861c1b-6409-4834-944e-c69ac57e2366 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:38.624411 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8861c1b-6409-4834-944e-c69ac57e2366 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:38.631567 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8861c1b-6409-4834-944e-c69ac57e2366 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:38.632019 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8861c1b-6409-4834-944e-c69ac57e2366 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:38.632795 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8861c1b-6409-4834-944e-c69ac57e2366 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:38.633235 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8861c1b-6409-4834-944e-c69ac57e2366 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:38.770937 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8861c1b-6409-4834-944e-c69ac57e2366 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:38.779180 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8861c1b-6409-4834-944e-c69ac57e2366 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1576 microversion: 2.1 time: 0.162622 Jul 04 06:33:38.779715 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1124/2266] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:38 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:39.807827 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-20b189f8-d8aa-4e47-b0cc-dd9e2140d6fc tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:39.808837 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-20b189f8-d8aa-4e47-b0cc-dd9e2140d6fc tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:39.819428 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20b189f8-d8aa-4e47-b0cc-dd9e2140d6fc tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:39.820166 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20b189f8-d8aa-4e47-b0cc-dd9e2140d6fc tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:39.821428 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20b189f8-d8aa-4e47-b0cc-dd9e2140d6fc tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:39.822167 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20b189f8-d8aa-4e47-b0cc-dd9e2140d6fc tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:39.966993 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20b189f8-d8aa-4e47-b0cc-dd9e2140d6fc tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:39.975084 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-20b189f8-d8aa-4e47-b0cc-dd9e2140d6fc tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1576 microversion: 2.1 time: 0.175430 Jul 04 06:33:39.975665 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1143/2267] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:39 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:40.993519 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b71a45d4-de67-4c9d-b20b-15d2cba98b63 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:40.994100 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b71a45d4-de67-4c9d-b20b-15d2cba98b63 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:41.002957 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b71a45d4-de67-4c9d-b20b-15d2cba98b63 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:41.003435 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b71a45d4-de67-4c9d-b20b-15d2cba98b63 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:41.004202 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b71a45d4-de67-4c9d-b20b-15d2cba98b63 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:41.004637 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b71a45d4-de67-4c9d-b20b-15d2cba98b63 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:41.143180 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b71a45d4-de67-4c9d-b20b-15d2cba98b63 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:41.151031 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b71a45d4-de67-4c9d-b20b-15d2cba98b63 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1576 microversion: 2.1 time: 0.162140 Jul 04 06:33:41.151724 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1125/2268] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:40 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:42.168784 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-33580afc-6c20-4095-a0af-1f08228e5ee8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:42.169393 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-33580afc-6c20-4095-a0af-1f08228e5ee8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:42.176399 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33580afc-6c20-4095-a0af-1f08228e5ee8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:42.176851 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33580afc-6c20-4095-a0af-1f08228e5ee8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:42.177633 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33580afc-6c20-4095-a0af-1f08228e5ee8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:42.178071 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33580afc-6c20-4095-a0af-1f08228e5ee8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:42.394571 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-33580afc-6c20-4095-a0af-1f08228e5ee8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:42.402635 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-33580afc-6c20-4095-a0af-1f08228e5ee8 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1576 microversion: 2.1 time: 0.237722 Jul 04 06:33:42.403182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1144/2269] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:42 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:43.421306 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7df70a31-2894-4ec3-bcb8-c3038f914dd4 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:43.421956 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7df70a31-2894-4ec3-bcb8-c3038f914dd4 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:43.429505 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7df70a31-2894-4ec3-bcb8-c3038f914dd4 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:43.430460 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7df70a31-2894-4ec3-bcb8-c3038f914dd4 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:43.431459 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7df70a31-2894-4ec3-bcb8-c3038f914dd4 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:43.431898 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7df70a31-2894-4ec3-bcb8-c3038f914dd4 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:43.564578 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7df70a31-2894-4ec3-bcb8-c3038f914dd4 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:43.572226 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7df70a31-2894-4ec3-bcb8-c3038f914dd4 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1576 microversion: 2.1 time: 0.155416 Jul 04 06:33:43.572788 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1126/2270] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:43 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:44.593472 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-139e4c8d-3540-4ba6-a16a-a5827f735203 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:44.594055 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-139e4c8d-3540-4ba6-a16a-a5827f735203 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:44.601957 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-139e4c8d-3540-4ba6-a16a-a5827f735203 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:44.602404 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-139e4c8d-3540-4ba6-a16a-a5827f735203 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:44.603169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-139e4c8d-3540-4ba6-a16a-a5827f735203 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:44.603643 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-139e4c8d-3540-4ba6-a16a-a5827f735203 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:44.736965 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-139e4c8d-3540-4ba6-a16a-a5827f735203 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:44.744797 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-139e4c8d-3540-4ba6-a16a-a5827f735203 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1576 microversion: 2.1 time: 0.158532 Jul 04 06:33:44.745966 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1145/2271] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:44 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:45.762145 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-897febef-cb55-45bf-ab04-a50dca936254 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:33:45.762758 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-897febef-cb55-45bf-ab04-a50dca936254 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:33:45.769789 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-897febef-cb55-45bf-ab04-a50dca936254 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:45.770241 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-897febef-cb55-45bf-ab04-a50dca936254 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:45.771020 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-897febef-cb55-45bf-ab04-a50dca936254 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:45.771590 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-897febef-cb55-45bf-ab04-a50dca936254 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:45.907112 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-897febef-cb55-45bf-ab04-a50dca936254 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:33:45.914907 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-897febef-cb55-45bf-ab04-a50dca936254 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1563 microversion: 2.1 time: 0.156741 Jul 04 06:33:45.915527 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1127/2272] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:33:45 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:33:47.864019 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-4fc132b3-6fd8-43bf-a91f-3d2918debf43 req-959bf33e-5643-474c-8783-2f1b794bc077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe8d554-ad9e-48f8-909a-a07fd4cc63da", "name": "network-vif-plugged", "status": "completed", "tag": "97e1d096-0047-4462-b327-16383878a1c0"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:33:47.873257 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-4fc132b3-6fd8-43bf-a91f-3d2918debf43 req-959bf33e-5643-474c-8783-2f1b794bc077 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:33:47.873700 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-4fc132b3-6fd8-43bf-a91f-3d2918debf43 req-959bf33e-5643-474c-8783-2f1b794bc077 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:33:47.885376 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-4fc132b3-6fd8-43bf-a91f-3d2918debf43 req-959bf33e-5643-474c-8783-2f1b794bc077 service nova] Creating event network-vif-plugged:97e1d096-0047-4462-b327-16383878a1c0 for instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da on hv-cinder-79733 Jul 04 06:33:47.890444 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-4fc132b3-6fd8-43bf-a91f-3d2918debf43 req-959bf33e-5643-474c-8783-2f1b794bc077 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030255 Jul 04 06:33:47.891096 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1146/2273] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:34:05.817749 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:34:05.818654 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:34:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:35:02.598382 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=26 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:35:02.602394 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=28 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:35:02.603538 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:35:02.604320 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:35:02.613607 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c1e4ef5-d548-4cde-a2e2-7a6ff696d608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:35:02.614111 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9c1e4ef5-d548-4cde-a2e2-7a6ff696d608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:35:02.621324 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c1e4ef5-d548-4cde-a2e2-7a6ff696d608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:02.621892 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c1e4ef5-d548-4cde-a2e2-7a6ff696d608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:02.622573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c1e4ef5-d548-4cde-a2e2-7a6ff696d608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:02.623005 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c1e4ef5-d548-4cde-a2e2-7a6ff696d608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:02.652625 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9c1e4ef5-d548-4cde-a2e2-7a6ff696d608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 06:35:02.682312 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-88604328-68d4-438f-8064-3a75d8f7ed7d req-87aa55b4-e791-454f-aef9-ab06439ffd53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe8d554-ad9e-48f8-909a-a07fd4cc63da", "tag": "97e1d096-0047-4462-b327-16383878a1c0"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:35:02.691066 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-88604328-68d4-438f-8064-3a75d8f7ed7d req-87aa55b4-e791-454f-aef9-ab06439ffd53 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:02.691541 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-88604328-68d4-438f-8064-3a75d8f7ed7d req-87aa55b4-e791-454f-aef9-ab06439ffd53 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:02.703064 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-88604328-68d4-438f-8064-3a75d8f7ed7d req-87aa55b4-e791-454f-aef9-ab06439ffd53 service nova] Creating event network-changed:97e1d096-0047-4462-b327-16383878a1c0 for instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da on hv-cinder-79733 Jul 04 06:35:02.708520 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-88604328-68d4-438f-8064-3a75d8f7ed7d req-87aa55b4-e791-454f-aef9-ab06439ffd53 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108190 Jul 04 06:35:02.709118 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1147/2274] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:35:02.754782 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9c1e4ef5-d548-4cde-a2e2-7a6ff696d608 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 204 len: 0 microversion: 2.1 time: 0.156266 Jul 04 06:35:02.756256 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1128/2275] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jul 4 06:35:02 2022] DELETE /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 06:35:02.765462 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42e0369a-459b-4068-b449-7b3da46039e0 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:35:02.766149 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-42e0369a-459b-4068-b449-7b3da46039e0 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:35:02.773182 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42e0369a-459b-4068-b449-7b3da46039e0 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:02.774374 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42e0369a-459b-4068-b449-7b3da46039e0 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:02.775118 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42e0369a-459b-4068-b449-7b3da46039e0 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:02.775617 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42e0369a-459b-4068-b449-7b3da46039e0 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:02.960960 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-42e0369a-459b-4068-b449-7b3da46039e0 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:35:02.968857 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-42e0369a-459b-4068-b449-7b3da46039e0 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.207888 Jul 04 06:35:02.969400 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1148/2276] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:35:02 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:35:03.986886 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c394d9cd-7dc9-4695-a973-e18a68c2ee17 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:35:03.987611 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c394d9cd-7dc9-4695-a973-e18a68c2ee17 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:35:03.994920 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c394d9cd-7dc9-4695-a973-e18a68c2ee17 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:03.995401 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c394d9cd-7dc9-4695-a973-e18a68c2ee17 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:03.996179 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c394d9cd-7dc9-4695-a973-e18a68c2ee17 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:03.996613 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c394d9cd-7dc9-4695-a973-e18a68c2ee17 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:04.192624 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c394d9cd-7dc9-4695-a973-e18a68c2ee17 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:35:04.200618 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c394d9cd-7dc9-4695-a973-e18a68c2ee17 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1569 microversion: 2.1 time: 0.217927 Jul 04 06:35:04.201334 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1129/2277] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:35:03 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:35:04.750188 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-1cdb0149-e9e0-428a-961c-2299a9032ce9 req-f10cbabb-b636-42d8-a35c-0ca97dc103a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe8d554-ad9e-48f8-909a-a07fd4cc63da", "name": "network-vif-deleted", "tag": "97e1d096-0047-4462-b327-16383878a1c0"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 06:35:04.759021 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-1cdb0149-e9e0-428a-961c-2299a9032ce9 req-f10cbabb-b636-42d8-a35c-0ca97dc103a2 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:04.759500 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-1cdb0149-e9e0-428a-961c-2299a9032ce9 req-f10cbabb-b636-42d8-a35c-0ca97dc103a2 service nova] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:04.770884 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-1cdb0149-e9e0-428a-961c-2299a9032ce9 req-f10cbabb-b636-42d8-a35c-0ca97dc103a2 service nova] Creating event network-vif-deleted:97e1d096-0047-4462-b327-16383878a1c0 for instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da on hv-cinder-79733 Jul 04 06:35:04.776326 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-1cdb0149-e9e0-428a-961c-2299a9032ce9 req-f10cbabb-b636-42d8-a35c-0ca97dc103a2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029808 Jul 04 06:35:04.776932 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1149/2278] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 4 06:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 06:35:05.218188 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4dcd4a8d-fb04-4368-88bc-5cd378916d96 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:35:05.218807 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4dcd4a8d-fb04-4368-88bc-5cd378916d96 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:35:05.225573 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dcd4a8d-fb04-4368-88bc-5cd378916d96 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:05.226018 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dcd4a8d-fb04-4368-88bc-5cd378916d96 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:05.226773 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dcd4a8d-fb04-4368-88bc-5cd378916d96 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:05.227200 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dcd4a8d-fb04-4368-88bc-5cd378916d96 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:05.259366 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dcd4a8d-fb04-4368-88bc-5cd378916d96 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:05.259744 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dcd4a8d-fb04-4368-88bc-5cd378916d96 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:05.260194 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-4dcd4a8d-fb04-4368-88bc-5cd378916d96 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lazy-loading 'fault' on Instance uuid fbe8d554-ad9e-48f8-909a-a07fd4cc63da {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 06:35:05.305531 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4dcd4a8d-fb04-4368-88bc-5cd378916d96 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfeaad253164dfe96a0ff1c3a578609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c59146021441f836a3b822b9c1d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 06:35:05.313239 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4dcd4a8d-fb04-4368-88bc-5cd378916d96 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 200 len: 1225 microversion: 2.1 time: 0.099045 Jul 04 06:35:05.313838 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1130/2279] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:35:05 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 06:35:06.335949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e10e9846-67a7-496e-b8c5-d0cd87a52c76 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:35:06.337117 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e10e9846-67a7-496e-b8c5-d0cd87a52c76 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] [instance: fbe8d554-ad9e-48f8-909a-a07fd4cc63da] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 06:35:06.347730 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e10e9846-67a7-496e-b8c5-d0cd87a52c76 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:06.348479 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e10e9846-67a7-496e-b8c5-d0cd87a52c76 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:06.349743 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e10e9846-67a7-496e-b8c5-d0cd87a52c76 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 06:35:06.350476 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e10e9846-67a7-496e-b8c5-d0cd87a52c76 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Lock "b04425d4-b271-4f52-96b4-9703962c8b23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 06:35:06.366988 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-e10e9846-67a7-496e-b8c5-d0cd87a52c76 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] HTTP exception thrown: Instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da could not be found. Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e10e9846-67a7-496e-b8c5-d0cd87a52c76 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Request method failure captured: Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da HTTP/1.1 Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept: application/json Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Connection: close Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Host: 10.222.0.42 Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABiwokCEY9SBCAl0WneZjxv3iPwabViMjtNJ87aQvOnSYY3Eji2UqO7igogpZ_J-QqYTsFpfm7BOR62Wpsw94IXvdWA07h7LzJUA0rweolg2B5lJYaXxyNts4mEsicPHgNXIuH1Xd-mYp9ixoET3oSPjnQ-XGIxqy6vczZSkz4L0suFN7w Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Id: e72c59146021441f836a3b822b9c1d1e Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-TestShelveInstance-752017278 Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Role: reader,member Jul 04 06:35:06.368992 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Roles: reader,member Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e72c59146021441f836a3b822b9c1d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e72c59146021441f836a3b822b9c1d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e72c59146021441f836a3b822b9c1d1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e72c59146021441f836a3b822b9c1d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-TestShelveInstance-752017278 Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Id: e72c59146021441f836a3b822b9c1d1e Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-TestShelveInstance-752017278 Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User: tempest-TestShelveInstance-752017278-project Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Id: dcfeaad253164dfe96a0ff1c3a578609 Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-TestShelveInstance-752017278-project Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: method: > Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: exception: Instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da could not be found. Jul 04 06:35:06.370442 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: action_args: {'id': 'fbe8d554-ad9e-48f8-909a-a07fd4cc63da'} Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da could not be found. Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 06:35:06.371388 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da could not be found. Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da could not be found. Jul 04 06:35:06.372741 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jul 04 06:35:06.373974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e10e9846-67a7-496e-b8c5-d0cd87a52c76 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Returning 404 to user: Instance fbe8d554-ad9e-48f8-909a-a07fd4cc63da could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 06:35:06.373974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e10e9846-67a7-496e-b8c5-d0cd87a52c76 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da" status: 404 len: 111 microversion: 2.1 time: 0.042464 Jul 04 06:35:06.373974 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1150/2280] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jul 4 06:35:06 2022] GET /compute/v2.1/servers/fbe8d554-ad9e-48f8-909a-a07fd4cc63da => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 06:35:06.540782 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-051ad06a-7922-4e0f-9f7d-9f314138b126 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] Calling method '.version_select at 0x7f204fe39a60>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 06:35:06.565384 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-051ad06a-7922-4e0f-9f7d-9f314138b126 tempest-TestShelveInstance-752017278 tempest-TestShelveInstance-752017278-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1694803443" status: 202 len: 0 microversion: 2.1 time: 0.028367 Jul 04 06:35:06.566217 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1131/2281] 10.222.0.42 () {58 vars in 1253 bytes} [Mon Jul 4 06:35:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1694803443 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 06:35:54.281239 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:35:54.282169 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:35:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:35:57.065941 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:35:57.066752 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:35:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:37:49.657763 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:37:49.658631 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:37:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:37:53.150948 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:37:53.151771 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:37:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:39:11.910466 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:39:11.911732 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:39:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:39:14.294949 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:39:14.296060 dv-cinder-797333-5-iscsi devstack@n-api.service[117607]: Mon Jul 4 06:39:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 06:39:17.077776 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 06:39:17.078713 dv-cinder-797333-5-iscsi devstack@n-api.service[117606]: Mon Jul 4 06:39:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!